-- Logs begin at Tue 2022-07-12 21:23:56 UTC, end at Tue 2022-07-12 22:25:08 UTC. -- Jul 12 21:57:01.196951 dv-cinder-802955-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 21:57:01.206012 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 21:57:01 2022] *** Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: nodename: dv-cinder-802955-7-iscsi Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: machine: x86_64 Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: clock source: unix Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: pcre jit disabled Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: detected number of CPU cores: 4 Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: current working directory: / Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: detected binary path: /usr/bin/uwsgi-core Jul 12 21:57:01.208590 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: your processes number limit is 47680 Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: your memory page size is 4096 bytes Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: detected max file descriptor number: 2048 Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: lock engine: pthread robust mutexes Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: thunder lock: enabled Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 21:57:01.209379 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 21:57:01.253741 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: Python main interpreter initialized at 0x55bbfc1af9c0 Jul 12 21:57:01.253741 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: python threads support enabled Jul 12 21:57:01.253741 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: your server socket listen backlog is limited to 100 connections Jul 12 21:57:01.253741 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: your mercy for graceful operations on workers is 90 seconds Jul 12 21:57:01.254081 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 21:57:01.254081 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: *** Operational MODE: preforking *** Jul 12 21:57:01.254343 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: *** uWSGI is running in multiple interpreter mode *** Jul 12 21:57:01.254343 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: spawned uWSGI master process (pid: 103391) Jul 12 21:57:01.254548 dv-cinder-802955-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 21:57:01.255110 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: spawned uWSGI worker 1 (pid: 103392, cores: 1) Jul 12 21:57:01.255491 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: spawned uWSGI worker 2 (pid: 103393, cores: 1) Jul 12 21:57:01.255602 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 21:57:01.920996 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 21:57:01.921622 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 21:57:03.061171 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 21:57:03.061171 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jul 12 21:57:03.061858 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 21:57:03.061858 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jul 12 21:57:03.065667 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 21:57:03.065667 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: from cryptography.utils import int_from_bytes Jul 12 21:57:03.066106 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 21:57:03.066106 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: from cryptography.utils import int_from_bytes Jul 12 21:57:05.573687 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 21:57:05.574269 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 21:57:05.574464 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 21:57:05.574831 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 21:57:05.575090 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 21:57:05.575694 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.576054 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.576381 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.576726 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.577058 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.577370 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.577694 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.578015 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.578342 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.578607 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.578923 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.579248 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-7-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.579569 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.579879 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.580192 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.580510 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.580841 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.581164 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.581469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.581971 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.582293 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 21:57:05.582668 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.582753 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 21:57:05.582820 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.583000 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.583121 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 21:57:05.583340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.583436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 21:57:05.583652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.583750 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 21:57:05.583964 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584067 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584287 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584375 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584603 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584689 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.584968 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585071 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585280 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585372 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585635 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585722 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-7-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.585958 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586045 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586285 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586373 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586599 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586692 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.586865 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587011 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587185 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587322 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587512 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-7-iscsi {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587631 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587836 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.587949 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588147 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588270 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588460 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588578 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588807 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.588931 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589118 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589250 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589444 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589566 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589753 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.589883 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.590184 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.590284 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.590489 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.590577 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.590797 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.591403 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.591634 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.591820 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592041 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592153 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592257 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592568 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592796 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.592893 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593116 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593215 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593428 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593539 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593749 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593851 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.593997 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594084 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594247 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594445 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-7-iscsi {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594562 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594765 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.594879 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595084 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595176 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595405 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595507 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595775 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.595860 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596081 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596164 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596386 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596471 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596692 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.596806 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597018 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597126 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597319 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597412 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597638 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597725 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.597983 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598067 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598303 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598389 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598627 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598712 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.598932 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599029 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599243 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599349 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599553 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599638 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599872 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.599972 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600182 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600274 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600489 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600761 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.600865 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601161 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601398 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601482 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601720 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.601816 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602035 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602125 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602286 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602371 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602539 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602632 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602858 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.602965 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603179 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603264 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603491 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603577 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603800 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.603975 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604120 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604277 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604413 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604549 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604692 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.604852 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605000 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605144 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605313 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605611 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605745 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.605926 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.606074 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.606237 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.606385 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.606611 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.607221 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.607411 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.607514 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.607734 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.607831 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608084 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608181 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608370 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608544 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608680 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.608834 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609010 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609098 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609330 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609429 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609644 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609738 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.609950 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610037 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610257 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610353 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610561 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610664 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610866 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.610952 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611175 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611265 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611480 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611574 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611785 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.611893 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612109 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612215 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612415 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612512 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612748 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.612838 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613048 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613134 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613352 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613657 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613741 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.613968 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614064 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614263 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614346 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614564 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614663 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614873 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.614957 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615182 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615279 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615485 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615579 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615784 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.615875 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616087 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616178 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616389 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616486 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616690 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.616840 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617014 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617107 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617316 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617467 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617616 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617701 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.617933 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618018 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618241 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618325 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618545 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618630 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618851 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.618949 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619154 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619246 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619468 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619553 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619775 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.619868 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.620084 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.620170 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.620406 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.620490 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.620742 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.620832 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.621045 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.621138 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.621364 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.621450 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.621673 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.621758 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.621982 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.622089 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.622518 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.622895 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.622997 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.623258 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.623360 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.623610 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.623756 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.623931 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.624094 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.624284 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.624440 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.624589 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.624766 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.624908 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.625013 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.625238 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.625336 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.625561 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.625649 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.625884 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.625974 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.626199 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.626288 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.626504 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.626590 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.626808 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.626964 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.627131 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.627219 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.627468 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.627606 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.627761 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.627857 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.628073 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.628161 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.628381 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.628467 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.628702 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 21:57:05.628832 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629062 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629175 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629373 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629460 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629689 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.629875 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630000 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630114 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630323 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630409 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630655 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630751 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.630970 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631056 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631286 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631369 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631598 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631691 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631911 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.631997 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632224 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632322 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632536 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632633 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632867 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.632964 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633188 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633280 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633507 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633592 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633824 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.633963 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634136 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634243 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634457 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634550 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634767 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.634851 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635079 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635163 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635389 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635475 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635696 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.635779 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636002 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636086 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636309 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636396 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636621 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.636751 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637016 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637127 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637270 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637356 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637603 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637771 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.637954 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638172 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638315 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638498 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638668 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638815 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.638984 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639134 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639298 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639479 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639611 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639785 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.639920 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640106 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640236 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640431 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640549 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640771 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.640865 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641091 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641178 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641406 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641497 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641720 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.641815 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642034 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642128 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642372 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642458 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642676 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642783 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.642991 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643077 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643304 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643389 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643615 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643712 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.643932 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644013 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644245 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644334 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644559 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644653 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644896 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.644991 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645203 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645322 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645514 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645655 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645831 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.645918 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646140 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646225 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646461 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646546 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646784 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.646869 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647098 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647251 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647407 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647545 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647681 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647826 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.647986 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648118 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648294 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648431 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648599 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648756 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.648934 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649085 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649221 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649363 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649528 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649666 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649833 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.649984 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650120 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650254 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650426 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650572 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650749 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.650895 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651059 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651204 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651365 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651502 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651672 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651820 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.651974 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652126 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652289 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652426 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652605 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652783 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.652951 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.653057 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.653268 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.653364 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654135 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654243 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654458 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654582 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654776 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.654909 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655115 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655252 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655448 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655585 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655758 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.655887 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656069 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656209 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656516 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656703 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.656818 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657039 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657125 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657357 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657457 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657663 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657776 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.657975 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658062 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658284 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658368 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658596 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658688 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658899 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.658991 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659208 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659293 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659517 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659689 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659829 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.659914 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660138 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660230 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660467 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660554 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660888 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.660988 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661111 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661195 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661539 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661727 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.661820 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662035 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662119 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662351 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662451 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662668 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662754 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.662979 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663063 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663296 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663382 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663607 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663701 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.663931 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664025 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664242 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664328 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664560 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664644 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664892 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.664991 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665214 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665306 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665529 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665612 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665857 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.665960 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666187 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666288 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666555 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666783 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.666884 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667095 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667179 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667411 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667573 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667716 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.667866 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668026 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668165 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668313 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668450 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668595 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.668772 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.669004 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.669750 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.669851 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670055 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670242 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670387 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670554 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670707 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.670872 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671029 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671184 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671371 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671491 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671664 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671798 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.671982 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672111 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672300 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672438 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672626 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672777 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.672974 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673086 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673298 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673411 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673614 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673719 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.673943 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674030 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674265 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674359 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674638 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674732 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674901 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.674987 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675305 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675523 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675605 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675864 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.675958 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676178 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676308 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676483 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676575 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676820 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.676909 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677146 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677230 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677461 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677581 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677774 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.677871 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678082 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678170 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678391 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678489 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678706 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.678794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679015 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679108 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679327 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679425 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679637 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679724 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.679942 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680028 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680249 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680343 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680561 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680648 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.680896 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681006 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681205 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681293 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681517 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681605 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681828 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.681916 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682133 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682221 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682442 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682531 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682762 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.682849 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683069 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683330 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683431 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683665 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683755 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.683982 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.684070 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.684292 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.684403 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.684633 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.684919 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685109 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685264 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685364 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685489 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685628 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685811 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.685972 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686121 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686282 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686444 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686593 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686771 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.686902 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687072 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687210 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687394 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687521 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687711 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.687809 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688027 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688116 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688355 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688451 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688672 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.688782 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689021 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689124 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689326 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689414 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689629 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689726 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.689932 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.690272 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.690501 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.690588 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.690805 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.690900 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691119 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691207 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691424 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691532 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691737 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.691838 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692044 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692176 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692443 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692655 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692790 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.692984 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693242 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693337 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693580 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693678 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693908 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.693995 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694231 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694326 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694555 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694670 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694881 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.694973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695178 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695266 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695502 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695604 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695808 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.695895 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696112 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696216 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696415 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696503 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696743 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.696837 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697056 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697153 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697361 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697456 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697669 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697763 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.697976 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698064 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698285 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698386 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698591 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698678 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698892 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.698980 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699195 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699291 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699503 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699599 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699811 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.699899 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.700128 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.700770 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.700999 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701140 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701313 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701404 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701623 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701722 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.701949 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702046 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702264 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702352 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702573 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702662 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702882 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.702978 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703189 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703278 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703492 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703580 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703815 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.703913 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704105 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704193 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704417 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704506 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704748 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.704838 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705051 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705140 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705375 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705465 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705693 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.705781 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706001 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706098 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706309 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706397 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706619 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706707 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.706927 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707029 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707234 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707325 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707538 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707626 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707854 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.707950 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708167 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708255 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708471 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708558 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708805 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.708908 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709112 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709198 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709416 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709502 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709720 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.709818 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710025 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710111 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710329 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710423 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710633 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710721 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.710936 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711022 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711236 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711330 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711539 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711629 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711844 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.711939 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712155 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712243 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712456 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712543 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712790 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.712894 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713095 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713192 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713402 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713489 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713712 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.713800 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714035 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714210 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714351 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714446 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714667 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714754 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.714993 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.715108 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.715302 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.715407 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.715607 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.715697 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.716512 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.716630 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.716853 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.717157 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.717259 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.717465 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.717686 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.717787 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718018 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718116 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718343 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718432 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718657 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718757 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.718969 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719067 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719289 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719378 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719601 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719690 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719910 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.719998 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720222 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720310 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720530 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720620 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720865 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.720957 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721176 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721265 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721484 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721793 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.721881 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722103 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722202 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722418 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722507 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722724 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.722815 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723035 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723131 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723340 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723436 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723651 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723738 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.723968 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724064 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724282 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724371 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724590 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724678 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.724927 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725077 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725241 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725374 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725546 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725635 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725872 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.725960 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726183 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726270 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726492 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726626 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726804 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.726952 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.727106 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.727279 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.727418 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.727726 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.727880 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728162 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728382 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728600 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728691 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728821 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.728979 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.729158 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.729371 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.729585 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.729722 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.729821 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.730037 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.730232 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.730334 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.730651 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.730757 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731024 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731113 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731336 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731442 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731676 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731765 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.731986 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732295 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732383 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732602 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732690 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.732941 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733031 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733259 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733364 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733576 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733673 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733894 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.733970 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734244 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734341 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734511 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734609 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734818 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.734906 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735129 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735224 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735445 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735548 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735754 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.735841 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736080 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736168 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736394 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736541 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736702 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.736880 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737043 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737195 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737333 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737519 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737649 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737843 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.737959 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.738167 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.738394 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.738483 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.738710 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.738804 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739025 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739113 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739334 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739432 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739647 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739736 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.739962 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740057 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740282 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740371 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740585 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740681 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.740922 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741023 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741249 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741336 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741566 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741654 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741890 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.741987 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742254 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742342 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742563 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742651 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742869 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.742967 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743186 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743273 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743515 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743623 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743823 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.743912 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744145 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744243 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744432 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744521 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744757 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.744850 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745069 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745175 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745392 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745479 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745702 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.745798 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746013 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746104 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746325 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746414 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746635 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746814 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.746941 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747153 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747271 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747472 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747595 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747796 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.747898 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748120 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748209 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748448 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748545 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748778 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.748885 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749099 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749188 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749414 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749512 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749740 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.749831 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750049 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750145 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750355 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750444 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750663 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750758 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.750969 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751057 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751294 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751381 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751601 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751690 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.751922 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752011 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752247 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752573 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752670 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.752911 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753012 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753245 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753347 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753573 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753671 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753893 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.753982 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754212 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754311 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754526 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754613 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754829 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.754924 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755134 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755268 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755443 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755538 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755752 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.755850 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756058 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756156 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756360 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756449 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756670 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756790 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.756998 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757089 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757303 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757390 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757604 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757690 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.757924 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758014 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758228 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758325 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758545 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758641 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758856 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.758947 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759179 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759280 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759558 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759773 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.759863 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760096 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760184 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760401 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760497 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760716 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.760830 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761045 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761156 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761351 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761449 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761683 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761769 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.761991 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.762077 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.762309 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.762470 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.762627 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.763199 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.763503 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.763606 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.763773 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.763878 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764089 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764248 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764403 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764581 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764741 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.764931 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765056 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765259 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765353 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765587 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765698 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.765902 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766000 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766208 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766294 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766524 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766809 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.766897 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767129 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767214 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767437 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767531 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767751 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.767837 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768061 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768161 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768364 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768477 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768673 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.768788 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769008 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769113 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769313 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769407 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769624 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769721 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.769936 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770023 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770243 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770404 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770557 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770653 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770866 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.770952 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771205 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771299 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771510 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771596 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771827 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.771919 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772146 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772234 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772465 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772552 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772818 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.772907 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773135 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773229 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773439 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773534 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773757 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.773852 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774073 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774167 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774391 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774476 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774701 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.774798 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775016 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775102 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775332 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775416 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775651 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775744 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.775965 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776083 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776273 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776373 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776589 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776688 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.776931 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777031 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777255 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777472 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777626 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777804 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.777945 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.778125 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.778259 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.778562 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.778721 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.778958 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.779104 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.779281 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.779601 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.779748 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.779918 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780009 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780237 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780341 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780555 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780655 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780902 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.780995 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781222 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781310 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781543 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781643 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781871 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.781960 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782180 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782275 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782492 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782590 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782806 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.782895 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783122 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783211 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783430 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783528 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783752 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.783853 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784065 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784162 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784372 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784463 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784693 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.784848 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785026 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785115 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785356 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785565 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785654 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.785925 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786013 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786249 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786342 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786581 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786678 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786893 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.786981 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787207 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787305 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787515 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787604 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787833 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.787928 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788141 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788237 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788454 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788560 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788797 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.788913 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789110 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789249 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789421 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789511 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789733 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.789880 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790048 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790251 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790362 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790573 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790662 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.790912 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791002 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791240 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791328 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791566 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791655 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791873 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.791962 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792182 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792270 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792488 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792585 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792831 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.792923 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793137 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793236 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793445 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793546 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793752 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.793842 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.794580 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.794705 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795042 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795284 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795374 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795666 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795791 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.795995 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.796117 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.796313 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.796438 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.796781 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.796873 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797097 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797221 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797413 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797547 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797776 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.797873 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798107 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798210 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798417 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798507 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798726 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.798838 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799053 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799164 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799368 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799458 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799694 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.799783 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800023 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800130 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800335 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800425 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800649 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.800841 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801007 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801093 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801295 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801614 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801711 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.801923 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802025 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802239 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802329 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802549 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802644 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802882 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.802984 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803195 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803293 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803502 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803591 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803810 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.803907 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804127 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804217 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804437 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804525 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804766 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.804862 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805077 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805165 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805388 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805486 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805702 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.805792 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806011 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806107 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806327 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806422 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806634 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806724 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.806943 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807030 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807249 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807345 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807558 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807646 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807868 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.807956 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808178 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808276 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808491 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808588 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808849 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.808939 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.809170 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.809283 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.809485 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.809626 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.809876 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810052 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810346 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810453 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810683 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810781 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.810997 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811085 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811314 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811404 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811629 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811869 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.811958 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812209 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812308 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812539 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812636 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812899 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.812991 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813240 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813345 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813556 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813647 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813869 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.813958 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814180 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814271 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814514 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814603 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814832 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.814930 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.815403 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.815495 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.815720 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.815808 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816035 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816123 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816351 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816488 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816666 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.816776 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817009 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817116 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817326 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817424 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817643 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817732 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.817957 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818053 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818266 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818354 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818663 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818885 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.818982 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819208 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819326 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819522 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819633 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819830 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.819930 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820138 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820235 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820450 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820539 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820782 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.820877 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821094 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821183 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821401 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821490 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821710 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.821801 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822019 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822108 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822321 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822407 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822628 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822718 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.822932 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823020 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823238 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823337 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823542 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823668 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823890 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.823986 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824156 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824296 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824460 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824621 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824789 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.824963 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.825094 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.825812 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.826012 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.826329 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.826427 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.826668 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.826760 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827000 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827099 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827319 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827410 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827644 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827785 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.827963 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828061 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828290 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828379 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828604 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828703 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.828955 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829044 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829272 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829381 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829645 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829786 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829877 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.829958 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830209 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830354 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830520 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830649 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830828 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.830964 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831137 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831264 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831488 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831616 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831736 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.831853 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832041 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832168 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832350 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832487 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832660 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832832 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.832999 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833135 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833310 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833618 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833746 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.833925 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834061 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834232 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834366 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834540 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834666 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834848 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.834987 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835162 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835289 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835468 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835593 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835780 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.835934 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836077 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836205 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836376 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836510 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836681 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.836886 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837017 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837188 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837313 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837432 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837625 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837750 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.837943 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838068 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838272 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838416 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838598 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838727 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.838910 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839034 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839234 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839383 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839575 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839728 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839862 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.839992 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.840167 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.840305 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.840508 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.840619 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.841414 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.841564 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.841907 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842039 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842232 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842500 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842609 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842846 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.842940 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.843097 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 21:57:05.843192 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.843488 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.843829 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.844146 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.844481 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.844833 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.845163 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.845487 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.845806 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.846143 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.846462 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.846786 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.847101 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.847420 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.847736 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.848058 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.848375 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.848692 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.849038 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.849360 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.849693 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.850025 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.850341 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.850677 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.851012 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.851364 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.851684 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.852038 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.852372 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.852747 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.853035 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.853349 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 21:57:05.853603 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 21:57:05.911457 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Registered counter for database nova_api Jul 12 21:57:05.917630 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO dbcounter [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Registered counter for database nova_api Jul 12 21:57:06.024974 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.030539 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_db.sqlalchemy.engines [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.032986 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.036957 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writer thread running {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.089790 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.context [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03585713-f424-48b7-abbc-188b30fcb0c0(cell1) {{(pid=103392) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 21:57:06.094536 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 21:57:06.094949 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.context [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03585713-f424-48b7-abbc-188b30fcb0c0(cell1) {{(pid=103393) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 21:57:06.096138 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 21:57:06.096957 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 21:57:06.098891 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_concurrency.lockutils [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 21:57:06.099087 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 21:57:06.100477 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_concurrency.lockutils [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 21:57:06.101091 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Registered counter for database nova_cell0 Jul 12 21:57:06.101298 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_concurrency.lockutils [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 21:57:06.103437 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_concurrency.lockutils [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 21:57:06.105098 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Registered counter for database nova_cell1 Jul 12 21:57:06.105437 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO dbcounter [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Registered counter for database nova_cell0 Jul 12 21:57:06.110087 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO dbcounter [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Registered counter for database nova_cell1 Jul 12 21:57:06.113474 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.114702 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.116952 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_db.sqlalchemy.engines [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.120754 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.121958 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writer thread running {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.123449 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.123560 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_db.sqlalchemy.engines [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.264188 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writer thread running {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.269115 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Registered counter for database nova_cell0 Jul 12 21:57:06.273043 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO dbcounter [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Registered counter for database nova_cell0 Jul 12 21:57:06.277982 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.282204 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG oslo_db.sqlalchemy.engines [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 21:57:06.283500 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.286545 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writer thread running {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 21:57:06.623868 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 21:57:06.629503 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: WARNING keystonemiddleware.auth_token [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 21:57:06.631240 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 21:57:06.636725 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: WARNING keystonemiddleware.auth_token [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 21:57:06.974932 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 21:57:06.980880 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 21:57:06.986535 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbfc1af9c0 pid: 103392 (default app) Jul 12 21:57:06.987495 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: WARNING keystonemiddleware.auth_token [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 21:57:06.988590 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:57:06.989792 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 12 21:57:06.990198 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue Jul 12 21:57:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:57:06.993476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: WARNING keystonemiddleware.auth_token [None req-f46d446e-0fb2-42ef-b25f-2a0cb731e824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 21:57:06.999263 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bbfc1af9c0 pid: 103393 (default app) Jul 12 21:58:24.531440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:24.533604 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002506 Jul 12 21:58:24.534017 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:24.547419 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_api:SELECT=3 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:24.548623 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_cell0:SELECT=3 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:24.549486 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_cell1:SELECT=3 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:24.550227 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:25.483451 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-2623f67f-e8d2-4fc0-bc23-4acc1700f80f admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:25.515330 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-2623f67f-e8d2-4fc0-bc23-4acc1700f80f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.973329 Jul 12 21:58:25.516799 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jul 12 21:58:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 21:58:27.809291 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:27.810417 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a9ac1dd3-ab6d-45f3-b936-6f2ca567e594 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Jul 12 21:58:27.811073 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:28.340794 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-95ee6d0d-3d8c-4ee3-8972-3d94a4c90b08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "name": "cirros256"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:28.362608 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 21:58:28.362608 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: warnings.warn(msg) Jul 12 21:58:28.394478 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-95ee6d0d-3d8c-4ee3-8972-3d94a4c90b08 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.576995 Jul 12 21:58:28.395152 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:28.410929 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:28.412362 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:28.413417 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:28.414491 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:28.641680 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-9f65a6d3-3230-4da9-8570-091627062ca4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:28.644118 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 21:58:28.644118 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 21:58:28.710276 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-9f65a6d3-3230-4da9-8570-091627062ca4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305839 Jul 12 21:58:28.716992 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jul 12 21:58:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:31.052436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-95ee6d0d-3d8c-4ee3-8972-3d94a4c90b08 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:31.054099 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-95ee6d0d-3d8c-4ee3-8972-3d94a4c90b08 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Jul 12 21:58:31.054768 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:31.755045 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-46335c1c-bae9-4487-90dd-9904ea126be1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:31.772861 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 21:58:31.772861 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 21:58:31.797837 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-46335c1c-bae9-4487-90dd-9904ea126be1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.737059 Jul 12 21:58:31.798765 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:31.812458 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c8d4385a-eefd-45b5-87bd-3f3b4da41d21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:31.814444 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 21:58:31.814444 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: warnings.warn(msg) Jul 12 21:58:31.854434 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c8d4385a-eefd-45b5-87bd-3f3b4da41d21 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045914 Jul 12 21:58:31.865177 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jul 12 21:58:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:34.161801 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-46335c1c-bae9-4487-90dd-9904ea126be1 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:34.162719 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-46335c1c-bae9-4487-90dd-9904ea126be1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 12 21:58:34.165069 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:34.567682 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-8829165b-8f0b-4475-8dda-22e8394fb96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "swap": 0}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:34.586464 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-8829165b-8f0b-4475-8dda-22e8394fb96d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416936 Jul 12 21:58:34.587124 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:34.598836 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e7e0c8b3-f223-4c7a-8536-cf228cdbfb51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:34.621711 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e7e0c8b3-f223-4c7a-8536-cf228cdbfb51 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026527 Jul 12 21:58:34.622272 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jul 12 21:58:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:36.864470 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-8829165b-8f0b-4475-8dda-22e8394fb96d admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:36.873507 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-8829165b-8f0b-4475-8dda-22e8394fb96d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002820 Jul 12 21:58:36.874578 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:37.332183 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-9d2d4b18-4ae4-4e9d-b201-27a3f215b8a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:37.358232 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-9d2d4b18-4ae4-4e9d-b201-27a3f215b8a0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477578 Jul 12 21:58:37.359477 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:37.378025 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c861dd7b-61cc-4093-9e68-b6440891ae84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:37.413094 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c861dd7b-61cc-4093-9e68-b6440891ae84 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045129 Jul 12 21:58:37.413942 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jul 12 21:58:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:39.692642 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-9d2d4b18-4ae4-4e9d-b201-27a3f215b8a0 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:39.694298 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-9d2d4b18-4ae4-4e9d-b201-27a3f215b8a0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Jul 12 21:58:39.694692 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:40.160600 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:40.183238 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482113 Jul 12 21:58:40.184204 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:40.196335 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-01b1b0bc-e6a6-477e-88ff-cb7dcc7f6111 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:40.220280 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-01b1b0bc-e6a6-477e-88ff-cb7dcc7f6111 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027565 Jul 12 21:58:40.220890 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jul 12 21:58:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:42.600229 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:42.601332 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jul 12 21:58:42.601843 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:43.092731 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-dc3126d7-f1cf-4fce-8a16-51d39f6dd98a admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:43.115909 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-dc3126d7-f1cf-4fce-8a16-51d39f6dd98a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.507561 Jul 12 21:58:43.116505 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jul 12 21:58:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 21:58:45.387414 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:45.389238 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ede6e75b-099e-4f37-a9ad-bdf9e31eb3e5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002478 Jul 12 21:58:45.389911 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:45.908261 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e9393f0b-a738-4c89-8fc5-31ce8047bf1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:45.925913 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e9393f0b-a738-4c89-8fc5-31ce8047bf1c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.524859 Jul 12 21:58:45.926501 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:45.939981 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-52ad37ae-9ecf-4f77-9608-73d7fecda8d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:45.969992 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-52ad37ae-9ecf-4f77-9608-73d7fecda8d3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034889 Jul 12 21:58:45.970943 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jul 12 21:58:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:48.251014 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-e9393f0b-a738-4c89-8fc5-31ce8047bf1c admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:48.252026 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-e9393f0b-a738-4c89-8fc5-31ce8047bf1c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 12 21:58:48.252517 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:48.663047 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-d9abfc3e-f02b-4ae8-aac7-9738ba8dbf71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:48.684400 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-d9abfc3e-f02b-4ae8-aac7-9738ba8dbf71 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424849 Jul 12 21:58:48.685782 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:48.698182 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-4bad5937-29a5-474a-ae9d-d3f38250d64d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:48.725274 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-4bad5937-29a5-474a-ae9d-d3f38250d64d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030995 Jul 12 21:58:48.725872 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jul 12 21:58:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:51.039361 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-d9abfc3e-f02b-4ae8-aac7-9738ba8dbf71 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:51.041068 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-d9abfc3e-f02b-4ae8-aac7-9738ba8dbf71 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002706 Jul 12 21:58:51.041479 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 21:58:51.431315 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-8dfe6a08-795f-4488-ab9a-c9061c72dd59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "vcpus": 2}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:51.452986 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-8dfe6a08-795f-4488-ab9a-c9061c72dd59 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405292 Jul 12 21:58:51.456759 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:51.466081 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-eec31179-df20-4c78-9fcd-b568d4ab0b5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:51.492130 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-eec31179-df20-4c78-9fcd-b568d4ab0b5e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029670 Jul 12 21:58:51.493395 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jul 12 21:58:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 21:58:53.766619 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-8dfe6a08-795f-4488-ab9a-c9061c72dd59 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:53.767625 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-8dfe6a08-795f-4488-ab9a-c9061c72dd59 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 12 21:58:53.768028 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:54.233394 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-b82e3291-4ef0-4606-ac2d-0c3a33475ce4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "name": "m1.large"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:54.254355 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-b82e3291-4ef0-4606-ac2d-0c3a33475ce4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479424 Jul 12 21:58:54.254910 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 21:58:54.267725 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-c43227a1-2f73-41fb-9f0a-2d4b70b665fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:54.296665 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-c43227a1-2f73-41fb-9f0a-2d4b70b665fe admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032821 Jul 12 21:58:54.301516 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jul 12 21:58:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 21:58:56.618234 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-b82e3291-4ef0-4606-ac2d-0c3a33475ce4 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:58:56.619241 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-b82e3291-4ef0-4606-ac2d-0c3a33475ce4 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 12 21:58:56.619639 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:58:57.084732 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:57.106897 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.481256 Jul 12 21:58:57.107453 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jul 12 21:58:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:58:57.119627 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-547e8e7c-1fc5-4f4b-8dc8-a4bb7a6635ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:58:57.127372 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:58:57.151825 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-547e8e7c-1fc5-4f4b-8dc8-a4bb7a6635ad admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036240 Jul 12 21:58:57.152696 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jul 12 21:58:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 21:59:17.253943 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:17.254948 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 12 21:59:17.255343 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 21:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:17.266406 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:59:17.645788 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-b7636e3f-1cce-4547-8a87-f993c7a9cafb admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:17.662664 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-b7636e3f-1cce-4547-8a87-f993c7a9cafb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400636 Jul 12 21:59:17.663752 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jul 12 21:59:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 21:59:18.733505 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:18.734515 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-dfb5a0fb-ebbe-41b0-ab35-6096f99bee4e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 12 21:59:18.734912 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:19.264965 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c81f9c0a-d01b-4491-9540-9f1b0686ff88 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:19.270602 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.wsgi [None req-c81f9c0a-d01b-4491-9540-9f1b0686ff88 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c81f9c0a-d01b-4491-9540-9f1b0686ff88 admin admin] Request method failure captured: Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept: application/json Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept-Encoding: gzip, deflate Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Connection: keep-alive Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Content-Length: 0 Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Host: 10.222.0.44 Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-System-Scope: None Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: User-Agent: python-novaclient Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Auth-Token: gAAAAABize62nBO2Ul_AUn0_a0odveTUdJvf6u9N-OVheSdbPSpGLmztHohF2_BKvzRDCjdRqQqdSC5b5anVrejKP7jooKA2mfZOFzLnd-I6DyjUhHOyxw26QDZdZKWFmuOZIPb6Dtu03R-xpeBm_jkwBcztZwttgQF5k0GG-tacDwGR1RB7F0c Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Id: None Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Name: None Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Identity-Status: Confirmed Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Is-Admin-Project: True Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Id: default Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Name: Default Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Name: admin Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Role: reader,member,admin Jul 12 21:59:19.274792 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Roles: reader,member,admin Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant: admin Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Name: admin Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User: admin Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Id: default Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Name: Default Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Name: admin Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: method: > Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: exception: Flavor 42 could not be found. Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: action_args: {'id': '42'} Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:19.276476 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:19.277436 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.278523 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c81f9c0a-d01b-4491-9540-9f1b0686ff88 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:19.279580 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c81f9c0a-d01b-4491-9540-9f1b0686ff88 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403206 Jul 12 21:59:19.279580 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jul 12 21:59:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:19.285971 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-169e2893-59c0-4bec-86ec-a3584d2ed04f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:19.289944 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 21:59:19.309485 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-169e2893-59c0-4bec-86ec-a3584d2ed04f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027015 Jul 12 21:59:19.310053 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 21:59:19.320230 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-f513c8d3-6a5e-4db0-b814-7132413b5bd7 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:19.341763 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-f513c8d3-6a5e-4db0-b814-7132413b5bd7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025320 Jul 12 21:59:19.342305 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 21:59:19.353469 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d9985142-43e0-4cd7-bbc5-b00f2337efb0 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:19.359795 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-d9985142-43e0-4cd7-bbc5-b00f2337efb0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d9985142-43e0-4cd7-bbc5-b00f2337efb0 admin admin] Request method failure captured: Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABize62nBO2Ul_AUn0_a0odveTUdJvf6u9N-OVheSdbPSpGLmztHohF2_BKvzRDCjdRqQqdSC5b5anVrejKP7jooKA2mfZOFzLnd-I6DyjUhHOyxw26QDZdZKWFmuOZIPb6Dtu03R-xpeBm_jkwBcztZwttgQF5k0GG-tacDwGR1RB7F0c Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 12 21:59:19.363024 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User: admin Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: method: > Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: exception: Flavor 42 could not be found. Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: action_args: {'id': '42'} Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:19.364564 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:19.365508 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:19.366766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d9985142-43e0-4cd7-bbc5-b00f2337efb0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:19.367950 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-d9985142-43e0-4cd7-bbc5-b00f2337efb0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016191 Jul 12 21:59:19.367950 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jul 12 21:59:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:20.331377 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-f513c8d3-6a5e-4db0-b814-7132413b5bd7 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:20.332395 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-f513c8d3-6a5e-4db0-b814-7132413b5bd7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 12 21:59:20.332827 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:20.857661 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-bbff2307-e008-4719-b3fc-a75a6a9ed664 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-bbff2307-e008-4719-b3fc-a75a6a9ed664 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-bbff2307-e008-4719-b3fc-a75a6a9ed664 admin admin] Request method failure captured: Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABize649IqJp_e9iYjebZpVChQipXq3lErgJKzPICg6MlpP-4PtDzUO-Q5QHcx9jHExP-q3ws6fZ7_pg3hAWRbE4B6nnRlOe8Mp85mFof-5_swMHU7s4WxHblAYeqCXszXRmfM365Gv_VNDwQhD8G19Axwbso8PndqdngAJQhkKmiRiCVk Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 12 21:59:20.868737 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User: admin Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: method: > Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: exception: Flavor 84 could not be found. Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: action_args: {'id': '84'} Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:20.870440 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:20.871383 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.872652 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-bbff2307-e008-4719-b3fc-a75a6a9ed664 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:20.873856 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-bbff2307-e008-4719-b3fc-a75a6a9ed664 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393057 Jul 12 21:59:20.873856 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jul 12 21:59:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:20.876588 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-e44bd23c-c116-40cc-9b89-4b51ab6c689f admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:20.891644 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-e44bd23c-c116-40cc-9b89-4b51ab6c689f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018578 Jul 12 21:59:20.892223 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 21:59:20.902531 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-eda2821f-a5fa-4c38-ae98-dcc0d5545697 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:20.916906 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-eda2821f-a5fa-4c38-ae98-dcc0d5545697 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017989 Jul 12 21:59:20.917479 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 21:59:20.927208 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-8e9246f0-0008-4942-95e8-2904f0ebd1d7 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:20.933667 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.wsgi [None req-8e9246f0-0008-4942-95e8-2904f0ebd1d7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-8e9246f0-0008-4942-95e8-2904f0ebd1d7 admin admin] Request method failure captured: Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept: application/json Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept-Encoding: gzip, deflate Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Connection: keep-alive Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Content-Length: 0 Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Host: 10.222.0.44 Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-System-Scope: None Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: User-Agent: python-novaclient Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Auth-Token: gAAAAABize649IqJp_e9iYjebZpVChQipXq3lErgJKzPICg6MlpP-4PtDzUO-Q5QHcx9jHExP-q3ws6fZ7_pg3hAWRbE4B6nnRlOe8Mp85mFof-5_swMHU7s4WxHblAYeqCXszXRmfM365Gv_VNDwQhD8G19Axwbso8PndqdngAJQhkKmiRiCVk Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Id: None Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Name: None Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Identity-Status: Confirmed Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Is-Admin-Project: True Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Id: default Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Name: Default Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Name: admin Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Role: reader,member,admin Jul 12 21:59:20.935220 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Roles: reader,member,admin Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant: admin Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Name: admin Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User: admin Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Id: default Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Name: Default Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Name: admin Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: method: > Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: exception: Flavor 84 could not be found. Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: action_args: {'id': '84'} Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:20.936934 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:20.938074 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:20.939973 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-8e9246f0-0008-4942-95e8-2904f0ebd1d7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:20.941280 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-8e9246f0-0008-4942-95e8-2904f0ebd1d7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013101 Jul 12 21:59:20.941280 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jul 12 21:59:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:21.913347 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-eda2821f-a5fa-4c38-ae98-dcc0d5545697 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:21.914342 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-eda2821f-a5fa-4c38-ae98-dcc0d5545697 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 12 21:59:21.914758 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:22.452564 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-54c0a53a-223f-4cfa-9af8-c09b53652444 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:22.458441 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.wsgi [None req-54c0a53a-223f-4cfa-9af8-c09b53652444 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-54c0a53a-223f-4cfa-9af8-c09b53652444 admin admin] Request method failure captured: Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept: application/json Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Accept-Encoding: gzip, deflate Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Connection: keep-alive Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Content-Length: 0 Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Host: 10.222.0.44 Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Openstack-System-Scope: None Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: User-Agent: python-novaclient Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Auth-Token: gAAAAABize65g6RbQu3WRfJKSW0OGxcyYTqGFmDwgSeUl2vAL7xdTaRe8zBVNpOCROZYDYf8fNrOn1Fj8hz3nVlhuhPZva24xZ0VOPxqMOUNKHQy2pnqnF9CiezR5DnHYs4oBChIaJqlunacbEaoPNYKiEgVM3sWCNXWfE-LigLVjT6hsmFN9ro Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Id: None Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Domain-Name: None Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Identity-Status: Confirmed Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Is-Admin-Project: True Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Id: default Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Domain-Name: Default Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Project-Name: admin Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Role: reader,member,admin Jul 12 21:59:22.459967 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Roles: reader,member,admin Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant: admin Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-Tenant-Name: admin Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User: admin Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Id: default Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Domain-Name: Default Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: X-User-Name: admin Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: method: > Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: exception: Flavor 451 could not be found. Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: action_args: {'id': '451'} Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:22.461509 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:22.462393 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.463435 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-54c0a53a-223f-4cfa-9af8-c09b53652444 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:22.464395 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-54c0a53a-223f-4cfa-9af8-c09b53652444 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.410675 Jul 12 21:59:22.464395 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 21:59:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:22.470943 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b83d12b2-60e5-4b10-9d97-96134a4bb00f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:22.484755 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-b83d12b2-60e5-4b10-9d97-96134a4bb00f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017352 Jul 12 21:59:22.485305 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 21:59:22.495211 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:22.510872 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019636 Jul 12 21:59:22.511404 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jul 12 21:59:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 21:59:22.520889 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-61da210f-2134-47aa-a6ee-a3a6c5007541 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:22.526301 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-61da210f-2134-47aa-a6ee-a3a6c5007541 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-61da210f-2134-47aa-a6ee-a3a6c5007541 admin admin] Request method failure captured: Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Host: 10.222.0.44 Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABize65g6RbQu3WRfJKSW0OGxcyYTqGFmDwgSeUl2vAL7xdTaRe8zBVNpOCROZYDYf8fNrOn1Fj8hz3nVlhuhPZva24xZ0VOPxqMOUNKHQy2pnqnF9CiezR5DnHYs4oBChIaJqlunacbEaoPNYKiEgVM3sWCNXWfE-LigLVjT6hsmFN9ro Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 12 21:59:22.527794 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3e825823085549c0909b324f2e7acb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3e825823085549c0909b324f2e7acb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Id: 3e825823085549c0909b324f2e7acb2a Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User: admin Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Id: a08b779b7e9045028b1b3a86939d306f Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: method: > Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: exception: Flavor 451 could not be found. Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: action_args: {'id': '451'} Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 21:59:22.529348 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:22.530340 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 12 21:59:22.531574 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-61da210f-2134-47aa-a6ee-a3a6c5007541 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 21:59:22.532790 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-61da210f-2134-47aa-a6ee-a3a6c5007541 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012081 Jul 12 21:59:22.532790 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 21:59:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 21:59:23.510607 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:23.511604 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 12 21:59:23.512002 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:24.042105 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-1b702909-67e3-4c83-8ec9-a47b6a5443a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:59:24.059569 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-1b702909-67e3-4c83-8ec9-a47b6a5443a9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409143 Jul 12 21:59:24.060106 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jul 12 21:59:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:59:25.030666 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:25.031667 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 12 21:59:25.032063 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:25.557582 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-29460a41-aa93-4d34-868a-94f7480f24aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:59:25.576235 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-29460a41-aa93-4d34-868a-94f7480f24aa admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406409 Jul 12 21:59:25.576793 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jul 12 21:59:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:59:26.556201 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:26.557236 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 12 21:59:26.557634 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:27.093766 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-ca730fd0-76f8-4183-8270-9107006c9876 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:59:27.111590 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-ca730fd0-76f8-4183-8270-9107006c9876 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414253 Jul 12 21:59:27.112134 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jul 12 21:59:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:59:28.120467 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:28.121537 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 12 21:59:28.122006 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:28.646347 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-87ebe960-e6f2-4658-9c96-be05d39d5000 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 21:59:28.665423 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-87ebe960-e6f2-4658-9c96-be05d39d5000 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403957 Jul 12 21:59:28.665964 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jul 12 21:59:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 21:59:29.693401 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:29.694395 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 12 21:59:29.694787 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 21:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 21:59:30.221100 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-ef18fa6d-130f-468e-9d37-da587ea5cae2 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 21:59:30.240399 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-ef18fa6d-130f-468e-9d37-da587ea5cae2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410205 Jul 12 21:59:30.240968 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue Jul 12 21:59:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:00:22.692443 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:22.693508 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-c3d832bd-afdc-4193-aaa2-9ee6a797ae07 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 12 22:00:22.694391 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jul 12 22:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:00:22.704747 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:00:23.096903 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-82098bac-0341-4403-93dd-99242171847c admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:23.116394 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-82098bac-0341-4403-93dd-99242171847c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415577 Jul 12 22:00:23.117090 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jul 12 22:00:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:00:23.138292 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG dbcounter [-] [103393] Writing DB stats nova_api:SELECT=14 {{(pid=103393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:00:23.142132 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-a3c750b7-6ac0-4486-94f3-0a1bbc15c9c5 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:23.149770 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-a3c750b7-6ac0-4486-94f3-0a1bbc15c9c5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013027 Jul 12 22:00:23.150297 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jul 12 22:00:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:00:23.161890 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-718200aa-82c7-4607-a9a7-582d85a5a28f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:23.169580 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-718200aa-82c7-4607-a9a7-582d85a5a28f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011342 Jul 12 22:00:23.170100 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jul 12 22:00:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:00:23.181991 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:23.189610 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011837 Jul 12 22:00:23.190139 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jul 12 22:00:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:00:23.203070 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-ed4ec1d7-a6a5-43b3-b2fa-480d8eb344e3 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:00:23.210888 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-ed4ec1d7-a6a5-43b3-b2fa-480d8eb344e3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011359 Jul 12 22:00:23.211420 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jul 12 22:00:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:03:40.577030 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:40.578049 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 12 22:03:40.578447 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 22:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:03:40.730806 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=6 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:03:40.942510 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:40.943679 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 22:03:40.943679 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 22:03:40.945158 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:40.945594 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:40.946412 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:40.946839 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:40.981666 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-4bbcd0c2-1950-4e79-bd7c-657409288206 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.252129 Jul 12 22:03:40.982164 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 22:03:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:03:41.893575 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:41.894616 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 12 22:03:41.895030 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 22:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:03:42.179393 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:42.180567 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 22:03:42.180567 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 22:03:42.181831 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:42.182320 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:42.183102 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:42.183526 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:42.204356 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-b6d3950f-4a63-4eb6-a314-2916f7b98be2 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156350 Jul 12 22:03:42.204961 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 22:03:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:03:53.531390 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:53.532401 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 22:03:53.532838 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 22:03:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:03:53.679732 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:03:53.680442 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:03:53.681131 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=8 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:03:53.730337 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:53.731582 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 22:03:53.731582 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 22:03:53.732816 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:53.733261 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:53.734052 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:53.734479 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:53.759832 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-f869a3bd-0ba9-41cf-b9d4-3a8103b72986 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084335 Jul 12 22:03:53.760309 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 22:03:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:03:54.613412 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: DEBUG nova.api.openstack.wsgi [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] Calling method '>' {{(pid=103393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:54.614814 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: INFO nova.api.openstack.requestlog [None req-ac1f84ac-0363-4c71-b5c5-88bbea7a0eb2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 Jul 12 22:03:54.615369 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: [pid: 103393|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jul 12 22:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:03:54.811828 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:03:54.813035 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 22:03:54.813035 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 12 22:03:54.814215 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:54.814650 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:54.815442 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:03:54.815862 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:03:54.837478 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-ab7aa5e5-8f9a-4b8d-9fd8-1917919f211f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080426 Jul 12 22:03:54.837952 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jul 12 22:03:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:04:51.053228 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: Tue Jul 12 22:04:51 2022 - graceful shutdown triggered... Jul 12 22:04:51.053737 dv-cinder-802955-7-iscsi devstack@n-api.service[103393]: Gracefully killing worker 2 (pid: 103393)... Jul 12 22:04:51.053462 dv-cinder-802955-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 22:04:51.054546 dv-cinder-802955-7-iscsi devstack@n-api.service[103392]: Gracefully killing worker 1 (pid: 103392)... Jul 12 22:04:52.053964 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: worker 1 buried after 1 seconds Jul 12 22:04:52.054460 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: worker 2 buried after 1 seconds Jul 12 22:04:52.054460 dv-cinder-802955-7-iscsi devstack@n-api.service[103391]: goodbye to uWSGI. Jul 12 22:04:52.055584 dv-cinder-802955-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 22:04:52.056165 dv-cinder-802955-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 22:04:52.059681 dv-cinder-802955-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 22:04:52.069981 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 22:04:52.072623 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 22:04:52 2022] *** Jul 12 22:04:52.072805 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 22:04:52.072942 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 22:04:52.073057 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: nodename: dv-cinder-802955-7-iscsi Jul 12 22:04:52.073166 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: machine: x86_64 Jul 12 22:04:52.073276 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: clock source: unix Jul 12 22:04:52.074320 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: pcre jit disabled Jul 12 22:04:52.074454 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: detected number of CPU cores: 4 Jul 12 22:04:52.074566 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: current working directory: / Jul 12 22:04:52.074688 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: detected binary path: /usr/bin/uwsgi-core Jul 12 22:04:52.074806 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: your processes number limit is 47680 Jul 12 22:04:52.074918 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: your memory page size is 4096 bytes Jul 12 22:04:52.075029 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: detected max file descriptor number: 2048 Jul 12 22:04:52.075147 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: lock engine: pthread robust mutexes Jul 12 22:04:52.075432 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: thunder lock: enabled Jul 12 22:04:52.075756 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 22:04:52.075922 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 22:04:52.120935 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: Python main interpreter initialized at 0x55f5519889c0 Jul 12 22:04:52.120935 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: python threads support enabled Jul 12 22:04:52.120935 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: your server socket listen backlog is limited to 100 connections Jul 12 22:04:52.120935 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: your mercy for graceful operations on workers is 90 seconds Jul 12 22:04:52.121362 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 22:04:52.121362 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: *** Operational MODE: preforking *** Jul 12 22:04:52.121698 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: *** uWSGI is running in multiple interpreter mode *** Jul 12 22:04:52.121698 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: spawned uWSGI master process (pid: 117917) Jul 12 22:04:52.123329 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: spawned uWSGI worker 1 (pid: 117937, cores: 1) Jul 12 22:04:52.121896 dv-cinder-802955-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 22:04:52.123546 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: spawned uWSGI worker 2 (pid: 117938, cores: 1) Jul 12 22:04:52.128813 dv-cinder-802955-7-iscsi devstack@n-api.service[117917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 22:04:52.804275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 22:04:52.805201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 22:04:54.025083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 22:04:54.025083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jul 12 22:04:54.025740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 22:04:54.025740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jul 12 22:04:54.046747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 22:04:54.046747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: from cryptography.utils import int_from_bytes Jul 12 22:04:54.047280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 22:04:54.047280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: from cryptography.utils import int_from_bytes Jul 12 22:04:56.410907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 22:04:56.411521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 22:04:56.411621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 22:04:56.411970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 22:04:56.412226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 22:04:56.412851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.413187 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.413509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.413827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.414160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.414469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.414986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.415307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.415633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.415895 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.416205 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.416528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-7-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.416886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.417237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.417588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.418018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.418324 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.418654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.418958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.419470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.420933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.420933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.421229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.421557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.421869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.422194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.422503 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.422802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.423131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.423442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.423847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-7-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.424172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.424490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.424816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.425245 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.425553 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.425872 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.426179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.426515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.426806 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.427137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.427555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.427771 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.428100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.428379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.428681 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.429013 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.429357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.429634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.429944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.430194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.430500 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.430821 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.431164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.431456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.431709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.431956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.432270 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.433155 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.433689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.434035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.434342 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.434655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.434962 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.437636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.438802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.438802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.438802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.438802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.439436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.439436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.439736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.440087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.440303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.440613 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.440945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.441267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.441604 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.441907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.442156 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.442483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.442765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.443082 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.443389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.443695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.444000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.444544 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.444883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.445186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.445492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.445795 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.446098 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.446429 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.446738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.447046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.447536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.447715 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.448048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.449201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.449519 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.450047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.450527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.450785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.451038 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.451252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.452291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.452291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.452291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.453053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.453053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.453346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.453496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.453812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.454117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.454442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.454753 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.455096 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.455402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.455668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.455975 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.456281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.456583 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.456910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.457211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.457528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.457847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.458160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.458465 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.458772 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.459090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.459430 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.459760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.460102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.460417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.460920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.461225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.461441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.461748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.462119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.462591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.462591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.462975 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.463209 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.463533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.463968 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.464480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.464822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.465925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.465925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.465925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.466419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.466419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.466709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.466988 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.467327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.467671 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.467983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.468307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.468629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.468965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.469276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.469587 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.469906 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.470244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.470561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.471433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.471433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.471644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.471775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.472085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.472400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.472748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.473061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.473374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.473690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.474009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.474322 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.474663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.474944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.475247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.475548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.475852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.476160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.476462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.476808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.477170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.477436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.477770 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.478074 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.478382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.478690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.478998 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.479301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.479637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.480049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.480283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.480562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.480894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.481200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.481520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.481822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.482124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.482506 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.482832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.483101 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.483319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.483629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.483954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.484259 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.484570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.484999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.485328 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.485630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.485952 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.486278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.486588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.486890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.487196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.487500 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.487801 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.488102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.488408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.488744 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.489036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.489339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.489640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.489940 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.490264 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.490568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.490869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.491197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.491467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.491807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.492189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.492522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.492860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.493094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.493594 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.493733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.494015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.494324 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.494635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.494945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.495960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.496347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.496627 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.497019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.497335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.497662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.497976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.498301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.498605 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.498920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.499258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.499593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.499910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.500238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.500549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.500886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.501195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.501505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.501813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.502121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.502436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.502747 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.503053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.503549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.503810 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.503960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.504272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.504571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.504914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.505245 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.505574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.505881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.506190 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.506509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.506815 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.507118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.507423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.507724 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.508025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.508329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.508638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.508969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.509358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.509572 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.509887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.510191 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.510491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.511390 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.511812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.512131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.512311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.512633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.512977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.513304 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.513568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.513931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.514194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.514494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.514796 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.515101 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.515442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.515751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.516053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.516368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.517577 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.517577 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.517577 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.518012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.518012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.518278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.518520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.518806 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.519118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.519428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.519735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.520049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.520371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.520677 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.521008 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.521317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.521617 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.521925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.522240 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.522816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.523140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.523455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.523774 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.524115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.524407 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.524763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.525094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.525433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.525737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.526048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.526474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.526825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.527181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.527426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.527729 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.528032 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.528338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.528639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.528967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.529268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.529656 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.529883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.530185 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.530494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.530794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.531113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.531421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.531723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.532026 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.532328 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.532762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.532991 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.533330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.533660 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.534001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.534346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.534596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.534916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.535215 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.535513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.535813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.536536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.536536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.536890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.537025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.537308 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.537614 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.537920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.538224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.538531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.538833 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.539144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.539451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.539754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.540052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.540358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.540662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.540984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.541291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.541592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.541903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.542434 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.542746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.543104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.543345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.543761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.544001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.544263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.544601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.544896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.545200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.545504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.545802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.546105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.546411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.546732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.547044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.547345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.547644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.547947 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.548246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.548545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.549021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.549186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.549462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.549761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.550059 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.550356 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.550673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.550980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.551280 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.551787 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.552031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.552345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.552520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.552876 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.553299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.553565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.553852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.554133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.554386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.554703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.555000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.555314 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.555621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.555930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.556229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.556529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.556865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.557175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.557488 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.558519 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.558703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.559024 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.559330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.559637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.559944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.560251 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.560557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.560885 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.561201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.561508 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.561816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.562126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.562436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.562739 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.563050 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.563353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.563654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.563973 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.564283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.564582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.564914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.565214 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.565523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.565823 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.566259 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.566571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.566879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.567181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.567560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.567798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.568110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.568420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.568737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.569157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.569722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.570031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.570339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.570640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.570941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.571250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.571569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.571871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.572172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.572472 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.572829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.573117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.573993 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.574416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.574721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.575024 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576652 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.576969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.577272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.577583 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.577892 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.578215 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.578535 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.578933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.579157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.579456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.579775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.580103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.580411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.580832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.581159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.581505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.581787 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.582109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.582432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.582736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.583036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.583343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.583645 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.584033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.584284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.584555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.584886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.585201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.585507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.585810 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.586113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.586435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.586738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.587057 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.587372 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.587692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.588010 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.588313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.588635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.589117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.589421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.589725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.590030 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.590370 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.590672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.590992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.591320 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.591646 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.591954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.592284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.592610 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.592951 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.593264 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.593585 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.593887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.594189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.594494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.594799 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.595097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.595396 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.595703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.596002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.596301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.596602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.596946 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.597247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.597568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.597876 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.598179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.598480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.598784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.599127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.599428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.599758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.600077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.600397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.600737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.601048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.601369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.601686 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.601997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.602309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.602622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.602933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.603246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.603557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.603862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.604253 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.604588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.605053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.605611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.605936 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.606248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.606560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.606869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.607179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.607490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.607800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.608112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.608417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.608737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.609067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.609391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.609712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.610042 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.610355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.610668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.610981 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.611294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.611648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.611960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.612265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.612574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.612943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.613257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.613567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.613874 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.614184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.614610 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.614806 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.615115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.615514 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.615798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.616118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.616448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.616790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.617103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.617415 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.617726 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.618710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.618710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.618867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.619172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.619520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.619806 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.620635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.620983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.621292 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.621693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.622006 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.622313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.622571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 22:04:56.622950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.623148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 22:04:56.623246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.623246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.623407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 22:04:56.623502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.623713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 22:04:56.623806 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.623973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 22:04:56.624154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.624371 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.624620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.624760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.625074 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.625176 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.625349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.625475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.625615 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.625719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.625938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.626032 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.626252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.626351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.626555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.626654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.626876 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.626977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.627166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.627266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.627467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.627566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.627778 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.627871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802955-7-iscsi {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.628084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.628175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.628383 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.628475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.628684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.628815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.629015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.629115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.629320 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.629422 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.629625 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.629718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.629932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.630023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.630234 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.630462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.630578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.630776 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.630869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.631084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.631185 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.631397 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.631491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.631714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.631813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.632015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.632118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.632314 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.632406 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.632612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.632722 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.632932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.633035 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.633237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.633337 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.633537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.633637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.633842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.633980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802955-7-iscsi {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.634142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.634301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.634447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.634616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.634762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.634938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.635044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.635354 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.635463 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.635691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.636416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.636561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.636655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.636935 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.637036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.637249 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.637378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.637560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.637695 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.637880 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.638028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.638188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.638353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.638505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.638679 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.638831 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.639003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.639145 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.639311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.639626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.639725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.639939 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.640042 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.640327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.640573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.640795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.640976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.641145 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.641326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.641491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.641661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.641829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.641999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.642193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.642413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.642577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.642739 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.642887 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.643045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.643219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.643374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.643540 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.643712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.643868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.644025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.644196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.644363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.644529 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.644689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.645101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.645193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.645308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.645403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.645489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.645575 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.645666 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.645820 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.645919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.646005 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.646098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.646193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.646286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.646386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.646480 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.646555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.646665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.646784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.646873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.647003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.647175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.647319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.647499 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.647635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.647910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.648015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.648163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.648257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.648477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.648571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.648846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.648958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.649158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.649250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.649469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.649570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.649793 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.649887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.650103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.650194 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.650408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.650511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.650721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.650836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.651034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.651149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.651404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.651565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.651860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.651961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.652174 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.652276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.652431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.652524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.652768 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.652877 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.653068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.653162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.653392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.653496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.653705 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.653816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.654021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.654150 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.654337 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.654433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.654646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.654761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.654955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.655057 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.655267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.655370 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.655579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.655673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.655882 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.655975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.656191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.656287 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.656496 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.656598 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.656823 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.656931 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.657131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.657232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.657440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.657531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.657766 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.657871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.658093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.658186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.658404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.658496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.658706 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.658806 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.659009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.659110 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.659315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.659423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.659619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.659712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.659921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.660022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.660223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.660317 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.660523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.660625 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.660847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.660999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.661149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.661252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.661459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.661561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.661762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.661856 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.662064 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.662158 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.662367 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.662468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.662667 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.662770 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.662967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.663068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.663288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.663378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.663601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.663704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.663913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.664015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.664225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.664338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.664536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.664634 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.664873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.664979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.665182 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.665275 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.665503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.665625 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.665801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.665899 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.666108 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.666211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.666416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.666510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.666750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.666852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.667199 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.667301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.667520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.667621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.667835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.667928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.668149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.668249 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 22:04:56.668460 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.668616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.668793 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.669804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670040 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670134 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670771 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.670993 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671085 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671305 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671399 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.671943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.672893 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673297 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673519 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.673936 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674231 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.674873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.675824 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.676842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677143 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677720 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.677813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.678886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 22:04:56.679084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.679303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.679624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.679951 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.680271 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.680589 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.680932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.681252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.681572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.681921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.682245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.683981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.683981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.683981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.684280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.684425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.684861 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.685184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.685638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.686201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.686770 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.687288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.687712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.688326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.688939 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.689518 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.690100 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.690504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.690844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.691175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.691715 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.692305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.692910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.693245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.693599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.693926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.694248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.694841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.695160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.695475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.695804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.696126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.696447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.696801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.697130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.697470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.697800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.698120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.699270 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.699617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.699930 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.700264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.700602 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.700998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.701315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.701745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.702064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.702375 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.702687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.703005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.703315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.703632 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.703942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.704256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.704561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.704925 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.705244 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.705556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.705864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.706175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.706545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.706841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.707205 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.707546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.707872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.708204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.708523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.708873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.709194 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.709525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.709846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.710154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.710477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.710795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.711124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.711440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.711797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.712093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.712992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.712992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.713160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.713464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.713740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.714289 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.714644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.714962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.715281 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.715596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.715912 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.716227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.716546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.716913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.717233 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.717561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.717878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.718209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.718526 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.718852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.719159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.719478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.719816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.720175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.720470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.720811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.721139 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.721452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.721764 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.722078 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.722388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.722697 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.723009 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.723329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.723641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.723953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.724262 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.724586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.724934 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.725245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.725552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.725868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.726198 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.726527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.726838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.727167 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.727480 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.727787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.728115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.728425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.728764 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.729067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.729380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.729760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.730340 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.730741 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.731064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.731394 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.731710 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.732032 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.732350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.732665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.733024 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.733346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.733660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.733976 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.734299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.734606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.734920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.735248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.735562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.735876 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.736190 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.736498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.736831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.737177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.737757 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.738101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.738423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.738748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.739073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.739487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.739732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.740070 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.740421 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.740755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.741076 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.741388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.741698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.742014 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.742324 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.742635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.742942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.743256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.743562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.743870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.744175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.744483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.744837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.745652 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.746058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.746609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.747016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.747339 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.747787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.747955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.748253 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.748604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.748943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.749288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.749677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.749965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.750276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.750583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.750912 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.751218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.751525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.751831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.752146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.752458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.752788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.753109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.753418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.753731 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.754042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.754350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.754664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.754975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.755288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.755602 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.755907 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.756211 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.756523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.756870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.757175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.757489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.757807 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.758103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.758401 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.758710 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.758996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.759306 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.759616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.759923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.760247 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.760563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.761428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.761753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.762063 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.762364 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.762671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.762982 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.763306 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.763625 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.763929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.764280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.764579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.764870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.765171 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.765479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.765784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.766090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.766394 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.766698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.767008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.767331 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.767646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.767955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.768260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.768569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.768946 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.769250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.769612 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.769928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.770228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.770542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.770857 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.771172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.771486 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.771789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.772107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.772418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.772779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.773058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.773361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.773683 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.773996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.774310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.774631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.774953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.775297 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.775580 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.775891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.776203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.776748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.777152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.777435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.777767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.778061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.778345 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.778664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.779000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.779252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.779566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.779880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.780187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.780513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.780850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.781160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.781471 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.781778 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.782092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.782397 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.782837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.783152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.784077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.784077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.784077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.784545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.784694 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.785000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.785307 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.785728 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.786043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.786355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.786669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.786979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.787283 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.787594 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.787921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.788226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.788531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.788861 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.789184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.789489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.789812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.790230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.790545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.790851 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.791266 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.791577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.791903 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.792240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.792564 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.792913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.793222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.793537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.793848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.794173 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.794498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.794814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.795130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.795434 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.795757 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.796080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.796667 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.796882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.797137 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.797461 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.797775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.798099 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.798428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.798777 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.799159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.799316 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.799614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.799919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.800242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.800558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.800890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.801236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.801518 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.801825 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.802132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.802458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.802764 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.803089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.803407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.803730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.804053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.804360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.804685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.805018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.805329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.805706 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.805944 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.806290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.806597 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.806923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.807256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.808115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.808604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.809048 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.809373 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.809541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.809803 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.810028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.810318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.810624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.810938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.811243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.811548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.811848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.812159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.812464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.812792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.813100 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.813425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.813730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.814054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.814367 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.814677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.814983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.815290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.815635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.815943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.816276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.816601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.816952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.817284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.817600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.817926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.818248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.818563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.818881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.819201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.819780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.820097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.820414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.820746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.821069 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.821387 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.821708 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.822271 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.822604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.822919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.823784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.824110 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.824432 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.824768 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.825087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.825435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.825754 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.826139 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.826422 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.826709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.827035 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.827379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.827696 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.828380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.828746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.829092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.829491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.829807 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.830065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.830369 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.830691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.831011 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.831419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.831690 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.831953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.832239 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.832550 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.832896 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.833222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.833538 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.833863 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.834203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.834383 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Registered counter for database nova_api Jul 12 22:04:56.834547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.834829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.835148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.835467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.836008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.836329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.836663 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.837018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.837348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.837672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.837990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.838318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.838627 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.839127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.839546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.839763 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.840072 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.840393 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.840721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.841037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.841454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.841671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.842209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.842563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.842883 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.843212 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.843539 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.843859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.844168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.844494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.844826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.845135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.845454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.845766 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.846070 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.846376 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.846687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.846997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.847301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.847614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.847926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.848253 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.848615 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.848898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.849179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.849491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.849804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.850112 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.850439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.850843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.851138 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.851671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.851671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.852005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.852231 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.852492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.852827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.853187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.853511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.853819 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.854964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.854964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.855269 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.855590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.855903 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.856218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.856313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:56.856574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.857011 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.857495 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.857838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.858163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.858505 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.858838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.859146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.859452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.859759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.860089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.860402 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.860736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.861043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.861354 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.861664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.861975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.862288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.862601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.862911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.863222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.863533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.863731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:56.863829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.864141 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.864462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.864826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.865149 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.865471 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.865790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.866110 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.866425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.866737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.867049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.867362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.867685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.868016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.868333 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.868641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.869097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.869414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.869737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.870157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.871068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.871542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.871880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.872204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.872534 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.872877 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.873217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.873568 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.873909 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.874241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.874596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.874861 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.875171 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.875490 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.875816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.876132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.876443 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.876773 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.877091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.877401 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.877711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.878018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.878326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.878636 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.878945 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.879251 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.879556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.879890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.880164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.880470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.880800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.881294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.881445 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.881714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.882022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.882326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.882656 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.883000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.883318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.883643 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.883959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.884283 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.884604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.884953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.885270 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.885590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.885935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.886273 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.886592 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.886902 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.887216 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.887530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.887849 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.888164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.888497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.888852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.889250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.889582 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.889905 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.890230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.890551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.890868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.891339 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.891564 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.891815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.892127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.892442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.892781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.893103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.893416 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.893731 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.894052 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.894371 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.894709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.895023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.895338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.895664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.895995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.896346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.896663 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.897038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.897370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.897689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.898003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.898311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 22:04:56.898557 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 22:04:56.923450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.context [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03585713-f424-48b7-abbc-188b30fcb0c0(cell1) {{(pid=117938) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 22:04:56.927707 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:04:56.929386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:04:56.930248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:04:56.932300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:04:56.935571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Registered counter for database nova_cell0 Jul 12 22:04:56.940183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Registered counter for database nova_cell1 Jul 12 22:04:56.948417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:56.949989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:56.960400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:56.960400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.051684 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Registered counter for database nova_api Jul 12 22:04:57.072597 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:57.079304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.111612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Registered counter for database nova_cell0 Jul 12 22:04:57.119597 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:57.124647 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.137315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.context [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),03585713-f424-48b7-abbc-188b30fcb0c0(cell1) {{(pid=117937) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 22:04:57.141557 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:04:57.143191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:04:57.144026 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:04:57.146089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:04:57.148108 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Registered counter for database nova_cell0 Jul 12 22:04:57.152578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Registered counter for database nova_cell1 Jul 12 22:04:57.160042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:57.167551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.309453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:57.315596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.325166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO dbcounter [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Registered counter for database nova_cell0 Jul 12 22:04:57.332637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_db.sqlalchemy.engines [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 22:04:57.337563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writer thread running {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 22:04:57.452355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 22:04:57.459705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 22:04:57.672931 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 22:04:57.680629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 22:04:57.805332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 22:04:57.811409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-8a4c5ee1-a362-4493-a3ef-532397edc09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 22:04:57.817689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5519889c0 pid: 117938 (default app) Jul 12 22:04:58.027031 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 22:04:58.033094 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: WARNING keystonemiddleware.auth_token [None req-6d6d11df-f7f6-4eca-998d-d0d16af9c263 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 22:04:58.039179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5519889c0 pid: 117937 (default app) Jul 12 22:05:39.872589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:39.874450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:39.875510 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:39.876906 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:40.605159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2e23da3d-ba03-4076-a918-a167059033ba tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Action: 'create', calling method: .version_select at 0x7f1b6ca73ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-389350114", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:05:41.107290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1f765c9b-d949-4a46-91ad-21b8edb1f32e tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6cabc790>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:41.140844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:41.142078 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:41.143395 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:41.144313 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:05:41.794645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1f765c9b-d949-4a46-91ad-21b8edb1f32e tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/7a6fda36-eff8-41ab-a866-aabaf2d1abaa" status: 200 len: 350 microversion: 2.1 time: 0.974142 Jul 12 22:05:41.795497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 1/1] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:40 2022] GET /compute/v2.1/os-volumes/7a6fda36-eff8-41ab-a866-aabaf2d1abaa => generated 350 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:41.895921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2e23da3d-ba03-4076-a918-a167059033ba tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.043608 Jul 12 22:05:41.904752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jul 12 22:05:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2054 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 22:05:41.909610 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-99fee134-99a1-4741-ab8f-8ecf96ae725a tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c90fa60>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:42.003196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-99fee134-99a1-4741-ab8f-8ecf96ae725a tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 200 len: 352 microversion: 2.1 time: 0.097351 Jul 12 22:05:42.008251 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:41 2022] GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:05:43.040984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2d3004b-109b-4833-b4e9-abdeadd1b7ca tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c8d0af0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:43.159548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2d3004b-109b-4833-b4e9-abdeadd1b7ca tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 200 len: 353 microversion: 2.1 time: 0.145722 Jul 12 22:05:43.160382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:43 2022] GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:43.171423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4e0499f0-cfce-4614-bd2b-8e38a213ef24 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c90f9d0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:43.349294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4e0499f0-cfce-4614-bd2b-8e38a213ef24 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 200 len: 353 microversion: 2.1 time: 0.181448 Jul 12 22:05:43.350671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:43 2022] GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:43.377695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-74c7ad94-e4c8-48b5-85f7-b77f665c15ae tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c8d0c10>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:43.563817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-74c7ad94-e4c8-48b5-85f7-b77f665c15ae tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 202 len: 0 microversion: 2.1 time: 0.191083 Jul 12 22:05:43.564773 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 3/6] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:05:43 2022] DELETE /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:05:43.580884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b31aa661-3cdb-422d-8786-fd09d488fbdd tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c8d9280>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:43.581825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-969bcf2c-331d-459f-92a6-4dd28ff08f88 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c8ea280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:43.684953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-969bcf2c-331d-459f-92a6-4dd28ff08f88 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/5f73fd43-be9a-4273-89ba-45ac85891e5a" status: 200 len: 351 microversion: 2.1 time: 0.111482 Jul 12 22:05:43.686530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:43 2022] GET /compute/v2.1/os-volumes/5f73fd43-be9a-4273-89ba-45ac85891e5a => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:43.785702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b31aa661-3cdb-422d-8786-fd09d488fbdd tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 200 len: 352 microversion: 2.1 time: 0.216280 Jul 12 22:05:43.786751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:43 2022] GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:44.800559 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-360cdd11-3b4e-4337-a143-bc4c54133135 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Calling method '.version_select at 0x7f1b6c8ea9d0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:44.852338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-360cdd11-3b4e-4337-a143-bc4c54133135 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] HTTP exception thrown: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-360cdd11-3b4e-4337-a143-bc4c54133135 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Request method failure captured: Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda HTTP/1.1 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfAzyfSasvb8rsmd6Zx75wQo3a3UtKF4M7BZShYiR0Z8dMNb6d5LnQmjO549xh8TGIcfEmHdg3x-rb_82V99htGrWLkuhHcsZeg-miEYp52iUIiOHr2SrWrOry1p9UaKm6jpXrE-P7Mkto2qFhPIyYPtbh3pg8VcUu__tAcEFGNfenc Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: c9496181d0314661a8645a5fc6f6f8a2 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesGetTestJSON-1400885940 Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:05:44.859683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c9496181d0314661a8645a5fc6f6f8a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c9496181d0314661a8645a5fc6f6f8a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c9496181d0314661a8645a5fc6f6f8a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c9496181d0314661a8645a5fc6f6f8a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesGetTestJSON-1400885940 Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: c9496181d0314661a8645a5fc6f6f8a2 Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesGetTestJSON-1400885940 Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesGetTestJSON-1400885940-project Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 7026b47ce1074361938e69abfd18f5fd Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesGetTestJSON-1400885940-project Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'efa62f54-7f89-4f8d-944f-741833cb7bda'} Jul 12 22:05:44.861017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. (HTTP 404) (Request-ID: req-47edb832-301a-448e-9cf8-2575ed377084) Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:05:44.861751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:05:44.862883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 22:05:44.863897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. Jul 12 22:05:44.864896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:05:44.869599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-360cdd11-3b4e-4337-a143-bc4c54133135 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] Returning 404 to user: Volume efa62f54-7f89-4f8d-944f-741833cb7bda could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:05:44.871994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-360cdd11-3b4e-4337-a143-bc4c54133135 tempest-VolumesGetTestJSON-1400885940 tempest-VolumesGetTestJSON-1400885940-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda" status: 404 len: 109 microversion: 2.1 time: 0.075773 Jul 12 22:05:44.880945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 5/9] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:44 2022] GET /compute/v2.1/os-volumes/efa62f54-7f89-4f8d-944f-741833cb7bda => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:05:45.548558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6c96a255-2cdc-4039-b2f5-a7875dee2c60 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c8d99d0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:45.716804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6c96a255-2cdc-4039-b2f5-a7875dee2c60 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/026867e0-a5a3-48fb-bb6c-2d1af5ebc762" status: 200 len: 350 microversion: 2.1 time: 0.171889 Jul 12 22:05:45.717680 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:05:45 2022] GET /compute/v2.1/os-volumes/026867e0-a5a3-48fb-bb6c-2d1af5ebc762 => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:45.736804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-85caca92-3afd-4f60-9448-4e315e0b0a77 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c850310>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:46.022897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-85caca92-3afd-4f60-9448-4e315e0b0a77 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.292122 Jul 12 22:05:46.023552 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 6/11] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jul 12 22:05:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:05:46.042066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-69bb5d49-c3ad-4f02-b588-007fb3fb0f9a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c8d9ca0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:46.241498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-69bb5d49-c3ad-4f02-b588-007fb3fb0f9a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.205679 Jul 12 22:05:46.253929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1148 bytes} [Tue Jul 12 22:05:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:46.264441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fdd930b6-5fee-4fe6-8800-4f0d9c4f776a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6d265040>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:46.500926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fdd930b6-5fee-4fe6-8800-4f0d9c4f776a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.240256 Jul 12 22:05:46.502693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jul 12 22:05:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:05:46.519805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9dbbb258-128d-4921-9785-7f6201797d3a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c8d90d0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:46.735670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9dbbb258-128d-4921-9785-7f6201797d3a tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.221322 Jul 12 22:05:46.735670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1166 bytes} [Tue Jul 12 22:05:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:46.761633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f3a13ec7-2bd4-48d6-a907-fa6ce4fd5707 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c850280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:47.125100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f3a13ec7-2bd4-48d6-a907-fa6ce4fd5707 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.375781 Jul 12 22:05:47.126141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 8/15] 10.222.0.44 () {58 vars in 1169 bytes} [Tue Jul 12 22:05:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:47.141911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a5d03881-4589-447c-ba08-0579a520a988 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c90f9d0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:47.385943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a5d03881-4589-447c-ba08-0579a520a988 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.248981 Jul 12 22:05:47.386680 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jul 12 22:05:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:05:47.398827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0e46677-5320-4339-8a62-bae35516f0f3 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c858700>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:47.603413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0e46677-5320-4339-8a62-bae35516f0f3 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.208799 Jul 12 22:05:47.604425 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1187 bytes} [Tue Jul 12 22:05:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:47.616007 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a74e8f83-fae7-418d-a5b7-a18afab189a6 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] Calling method '.version_select at 0x7f1b6c8d9c10>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:05:47.783942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a74e8f83-fae7-418d-a5b7-a18afab189a6 tempest-VolumesTestJSON-1959963118 tempest-VolumesTestJSON-1959963118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.171899 Jul 12 22:05:47.784580 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 9/18] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jul 12 22:05:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:05:55.231475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-11a5ecf6-7284-47da-acc8-e9cc831406f1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: .version_select at 0x7f1b6c858d30>, body: {"keypair": {"name": "tempest-keypair-736399504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMjpoW2Jsf1WuYn5sBMRqCwzDYjr6bMDhSUXrXggsreZRumYZCQNIJfH0I26a0DzIBKizit5tx2fIt+XYeX7wBU6e91QC8XeqFPqPYg3gUnY+OfZqvdT27METFgS75JFw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:05:55.425867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-11a5ecf6-7284-47da-acc8-e9cc831406f1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:05:55.464886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-11a5ecf6-7284-47da-acc8-e9cc831406f1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:05:55.621847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-11a5ecf6-7284-47da-acc8-e9cc831406f1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.780560 Jul 12 22:05:55.634677 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 10/19] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:05:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:05:56.750775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-93c071d2-b9f9-45ab-b20f-c6328a9ad019 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: .version_select at 0x7f1b6c8d9d30>, body: {"keypair": {"name": "tempest-keypair-1958238657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI58tNihIfnnrApeHGqWtw+jrRxbUgXE6gpvFhBlYix3yA7jNJq1TiW/2wHVJTGdbSkqr1cL2EB0l2dNIN56t/nNpgbKLlIC6A0orY4m+WSx/m/yG0enznxRl7cYmXpmZg=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:05:56.956388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-93c071d2-b9f9-45ab-b20f-c6328a9ad019 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for project 807d2d1b808448bca8aaf30389c8c571. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:05:56.999987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-93c071d2-b9f9-45ab-b20f-c6328a9ad019 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for user 4a746b42824c4d13a1d0b0f2c5831259 and project 807d2d1b808448bca8aaf30389c8c571. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:05:57.157487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-93c071d2-b9f9-45ab-b20f-c6328a9ad019 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.468039 Jul 12 22:05:57.161398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 10/20] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jul 12 22:05:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1473 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 22:05:59.526929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1734567684", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "networks": [{"uuid": "2e8d4c2b-4728-40e8-b9b8-9a16d0038d62"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:05:59.714766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] validate_networks() for [('2e8d4c2b-4728-40e8-b9b8-9a16d0038d62', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:06:00.600400 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-80fd722c-3b33-4537-a6d5-be6f30d3c93b tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Action: 'create', calling method: .version_select at 0x7f1b6c8ad790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254150107", "metadata": {"Type": "work"}}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-80fd722c-3b33-4537-a6d5-be6f30d3c93b tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 121 Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:00.629835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254150107", "metadata": {"Type": "work"}}} Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:00.631442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-254150107', 'metadata': {'Type': 'work'}}}} Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise error Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:00.632286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 22:06:00.634140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 22:06:00.635344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 22:06:00.635344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.636494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-80fd722c-3b33-4537-a6d5-be6f30d3c93b tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:00.637655 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-80fd722c-3b33-4537-a6d5-be6f30d3c93b tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.622666 Jul 12 22:06:00.638942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 11/21] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jul 12 22:06:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 624 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 22:06:00.653702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-187d1a9b-cf1c-4ec8-9ab7-ee3532cf0615 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Action: 'create', calling method: .version_select at 0x7f1b6c90fca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1705575034", "metadata": {"Type": "work"}}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-187d1a9b-cf1c-4ec8-9ab7-ee3532cf0615 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 120 Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:00.661320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1705575034", "metadata": {"Type": "work"}}} Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:00.662590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1705575034', 'metadata': {'Type': 'work'}}}} Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise error Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi '0' Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:00.663437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 22:06:00.665826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 22:06:00.666721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 22:06:00.666721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.669270 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-187d1a9b-cf1c-4ec8-9ab7-ee3532cf0615 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:00.670282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-187d1a9b-cf1c-4ec8-9ab7-ee3532cf0615 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025460 Jul 12 22:06:00.676446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 12/22] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jul 12 22:06:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 22:06:00.681891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5c7d3084-c02b-4144-9244-a6f3c52fd3b0 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Action: 'create', calling method: .version_select at 0x7f1b67ff00d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2126571915", "metadata": {"Type": "work"}}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5c7d3084-c02b-4144-9244-a6f3c52fd3b0 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 119 Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:00.684388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2126571915", "metadata": {"Type": "work"}}} Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:00.685626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2126571915', 'metadata': {'Type': 'work'}}}} Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise error Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi '' Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:00.686292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 22:06:00.687392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 22:06:00.688890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 22:06:00.688890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.690245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5c7d3084-c02b-4144-9244-a6f3c52fd3b0 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:00.691487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5c7d3084-c02b-4144-9244-a6f3c52fd3b0 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013776 Jul 12 22:06:00.698077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 13/23] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jul 12 22:06:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:06:00.704635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-49b720a4-9404-4cac-b9ae-d16df5889cb9 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Calling method '.version_select at 0x7f1b6c868430>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:00.794157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-49b720a4-9404-4cac-b9ae-d16df5889cb9 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] HTTP exception thrown: Volume tempest-invalid-1231707016 could not be found. Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-49b720a4-9404-4cac-b9ae-d16df5889cb9 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1231707016 HTTP/1.1 Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:00.798360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Volume tempest-invalid-1231707016 could not be found. Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'tempest-invalid-1231707016'} Jul 12 22:06:00.799574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1231707016 could not be found. (HTTP 404) (Request-ID: req-56737c45-154d-4b63-9bf1-9fcb0fff5957) Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.800279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:06:00.801350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1231707016 could not be found. Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:00.802796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1231707016 could not be found. Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1231707016 could not be found. Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.805116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-49b720a4-9404-4cac-b9ae-d16df5889cb9 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 404 to user: Volume tempest-invalid-1231707016 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:00.808148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-49b720a4-9404-4cac-b9ae-d16df5889cb9 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1231707016" status: 404 len: 99 microversion: 2.1 time: 0.106740 Jul 12 22:06:00.808936 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 14/24] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jul 12 22:06:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1231707016 => generated 99 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 22:06:00.823875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9f7f3063-725c-40e2-ac88-dbfec312a8ad tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009189 Jul 12 22:06:00.826850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jul 12 22:06:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 22:06:00.838102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-586d44c0-ab7a-4fb0-9bc3-d6194af53b95 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004138 Jul 12 22:06:00.842297 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 16/26] 10.222.0.44 () {58 vars in 1136 bytes} [Tue Jul 12 22:06:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 22:06:00.854689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0a65b456-3564-43ed-a264-be11a1f239f5 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Calling method '.version_select at 0x7f1b67f44430>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:00.952882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-0a65b456-3564-43ed-a264-be11a1f239f5 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] HTTP exception thrown: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0a65b456-3564-43ed-a264-be11a1f239f5 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/os-volumes/385f7518-c3ec-4205-8f42-1dec0d4498af HTTP/1.1 Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:00.956654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '385f7518-c3ec-4205-8f42-1dec0d4498af'} Jul 12 22:06:00.957789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. (HTTP 404) (Request-ID: req-d8e5bebd-fb62-4169-8a21-8d1f2b010661) Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.958448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:06:00.959338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 22:06:00.960230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0a65b456-3564-43ed-a264-be11a1f239f5 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 404 to user: Volume 385f7518-c3ec-4205-8f42-1dec0d4498af could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0a65b456-3564-43ed-a264-be11a1f239f5 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/385f7518-c3ec-4205-8f42-1dec0d4498af" status: 404 len: 109 microversion: 2.1 time: 0.110310 Jul 12 22:06:00.961232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 17/27] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:06:00 2022] DELETE /compute/v2.1/os-volumes/385f7518-c3ec-4205-8f42-1dec0d4498af => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:06:00.978860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-137f9eb5-3986-40fc-8848-a6432d7694b1 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Calling method '.version_select at 0x7f1b6c868d30>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:01.041492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-137f9eb5-3986-40fc-8848-a6432d7694b1 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] HTTP exception thrown: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-137f9eb5-3986-40fc-8848-a6432d7694b1 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Request method failure captured: Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/os-volumes/372a8c60-4df7-40b2-a14c-558bd002ce14 HTTP/1.1 Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBH08lWIf72XL8zQ0y-zmu3luFvAa5xI1m737ATMu4o3lpSYG3J1rmdBH7iTXKvIJJvKqNg0OJwmMTvvhRQVKrvoF5BiTLFDI6i3Gy34rxbR01QL0FqQLyrLYCCWouM1hOGGFxzfdthIRiaaBbR7l5XFQjxXtuFZE5BiUlEb2AdHrw Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:01.044621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef2df8c0c5be453880b88a8b5e65835d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: ef2df8c0c5be453880b88a8b5e65835d Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-1192504968 Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 9d4fb2af9f6a42a7a56195b9e6c0e1a0 Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-1192504968-project Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '372a8c60-4df7-40b2-a14c-558bd002ce14'} Jul 12 22:06:01.045786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. (HTTP 404) (Request-ID: req-21ef547e-b103-45a5-947d-fda7608e314c) Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:01.046437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:06:01.047344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 22:06:01.048226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-137f9eb5-3986-40fc-8848-a6432d7694b1 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] Returning 404 to user: Volume 372a8c60-4df7-40b2-a14c-558bd002ce14 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-137f9eb5-3986-40fc-8848-a6432d7694b1 tempest-VolumesNegativeTest-1192504968 tempest-VolumesNegativeTest-1192504968-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/372a8c60-4df7-40b2-a14c-558bd002ce14" status: 404 len: 109 microversion: 2.1 time: 0.072879 Jul 12 22:06:01.049154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 18/28] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:06:00 2022] GET /compute/v2.1/os-volumes/372a8c60-4df7-40b2-a14c-558bd002ce14 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:06:01.200867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1494666797", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afbe5681-6e61-4873-a265-db662a1dd309"}], "security_groups": [{"name": "tempest-securitygroup--509583290"}], "key_name": "tempest-keypair-736399504", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:01.495917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] validate_networks() for [('afbe5681-6e61-4873-a265-db662a1dd309', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:06:02.994600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:06:02.995212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:06:02.995800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:06:02.996121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:06:02.996589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:06:03.020291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:03.020724 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:03.021647 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:03.030175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:03.123076 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Getting quotas for project bdc783af528d4cd2a2b05519449924d9. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:06:03.134307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Getting quotas for user bf13eeff770b406796ab7008b8429637 and project bdc783af528d4cd2a2b05519449924d9. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:06:03.152869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:06:03.156164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:06:03.275634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76d8741f-c8f3-4319-9867-e3723352fba0 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.396972 Jul 12 22:06:03.276513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 11/29] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:06:03.311573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1924413079", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e029eadb-c9d8-4233-ad24-02330e3aa8fe"}], "security_groups": [{"name": "tempest-securitygroup--257349370"}], "key_name": "tempest-keypair-1958238657", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:03.618699 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] validate_networks() for [('e029eadb-c9d8-4233-ad24-02330e3aa8fe', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:06:04.059418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:06:04.059418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:06:04.059418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:06:04.059418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:06:04.059418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:06:04.076320 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:04.078696 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:04.079576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:04.081487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:04.157363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:06:04.169159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:06:04.204220 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:06:04.214591 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:06:04.486199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e501d50a-78d6-45f3-b75b-30103bf94005 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.294334 Jul 12 22:06:04.487290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 19/30] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:06:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 3297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:06:04.509147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1ba85daa-fa16-4839-a531-e9e44d397eeb tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:04.513844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1ba85daa-fa16-4839-a531-e9e44d397eeb tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:04.799629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1ba85daa-fa16-4839-a531-e9e44d397eeb tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:04.825770 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:06:04.826365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:06:04.826832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:06:04.827244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:06:04.827743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:06:04.843800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1ba85daa-fa16-4839-a531-e9e44d397eeb tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1215 microversion: 2.1 time: 0.348230 Jul 12 22:06:04.845716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 20/31] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:04 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:04.854362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5c1f3211-d2d0-48a0-82a6-604cc9f1fd9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:04.860369 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5c1f3211-d2d0-48a0-82a6-604cc9f1fd9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:04.869381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:04.872153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:04.873366 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:04.873978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:04.900900 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for project 807d2d1b808448bca8aaf30389c8c571. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:06:04.905554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for user 4a746b42824c4d13a1d0b0f2c5831259 and project 807d2d1b808448bca8aaf30389c8c571. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:06:04.929863 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:06:04.933449 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:06:05.001051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5c1f3211-d2d0-48a0-82a6-604cc9f1fd9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:05.010462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5c1f3211-d2d0-48a0-82a6-604cc9f1fd9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1241 microversion: 2.1 time: 0.162837 Jul 12 22:06:05.015759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 21/32] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:04 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:05.047346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ab74b1e-548b-4957-bcd2-e610c7b41cf7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.761008 Jul 12 22:06:05.048391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 12/33] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jul 12 22:06:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 22:06:05.060920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:05.062478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:05.257107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:05.275249 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:05.282250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:05.282953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-55355f44-851f-4be3-80d9-fc533e4caf77 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1282 microversion: 2.20 time: 0.228272 Jul 12 22:06:05.285815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 22/34] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:05 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:05.863319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:05.863994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:05.900016 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:05.913974 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:05.920003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:05.921111 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:06.039934 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-bfc44df2-3106-4fc3-90b6-31ced92aef1b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:06.041264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-bfc44df2-3106-4fc3-90b6-31ced92aef1b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:06.268319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-bfc44df2-3106-4fc3-90b6-31ced92aef1b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:06.286141 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-bfc44df2-3106-4fc3-90b6-31ced92aef1b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1241 microversion: 2.1 time: 0.250446 Jul 12 22:06:06.286795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 23/35] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:06 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1241 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:06.306166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:06.306897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:06.332467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:06.332950 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:06.342578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:06.343044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:06.569135 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:06.604898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4cbf0a38-c712-4825-93df-21f938887fac tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1219 microversion: 2.1 time: 0.743950 Jul 12 22:06:06.608093 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 13/36] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:05 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1219 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:06.880448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:06.919814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:06.921492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:06.922775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-86a9887c-5efd-4b6f-a044-097467443af4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1278 microversion: 2.20 time: 0.621135 Jul 12 22:06:06.926278 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 24/37] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:06 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1278 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:07.306654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:07.308139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:07.323208 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.326276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:07.327314 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.329441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:07.473318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:07.487297 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9180fa06-216b-44de-a2c7-d4aeabb36203 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1237 microversion: 2.1 time: 0.187196 Jul 12 22:06:07.487893 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 14/38] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:07 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:07.627017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:07.627673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:07.649446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.655863 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:07.661713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.662180 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:07.896545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:07.910642 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-cc758704-73d3-4e9b-a757-b55db4eea339 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1267 microversion: 2.1 time: 0.288299 Jul 12 22:06:07.913546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 25/39] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:07 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:07.943055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:07.944091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:07.981112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.982578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:07.987817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:07.988409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:08.177697 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:08.208746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:08.214847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:08.218110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a13d485d-60d1-4488-bf01-7b0f9873d11b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1340 microversion: 2.20 time: 0.280354 Jul 12 22:06:08.222371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 15/40] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:07 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1340 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:08.519544 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:08.525999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:08.546048 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:08.548391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:08.550435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:08.553184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:08.879664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:08.891273 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ea93d66c-d412-4f20-b644-ec903e82757b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1311 microversion: 2.1 time: 0.389112 Jul 12 22:06:08.892163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 26/41] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:08 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:08.931713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:08.932419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:08.941044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:08.946874 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:08.948130 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:08.949764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:09.241301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:09.241929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:09.250131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:09.250581 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:09.252048 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:09.252623 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:09.299999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:09.325158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1ea08c43-6c3e-417c-b7e1-b398bf70f982 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1273 microversion: 2.1 time: 0.398659 Jul 12 22:06:09.326378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 16/42] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:08 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:09.513353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:09.531865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:09.536812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:09.542177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c199b1f2-c2b4-4344-b624-fd1c31e91d45 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1340 microversion: 2.20 time: 0.303642 Jul 12 22:06:09.559225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 27/43] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:09 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1340 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:09.911993 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:09.912845 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:09.926515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:09.927288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:09.928347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:09.928967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:10.202642 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:10.214461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-df430ae2-14bf-4fff-98b2-a9967522a1f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1299 microversion: 2.1 time: 0.306008 Jul 12 22:06:10.217073 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 17/44] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:09 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:10.343368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:10.345805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:10.364294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:10.369039 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:10.373181 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:10.388060 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:10.565145 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:10.566408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:10.599474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:10.600695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:10.602693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:10.603352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:10.850670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:10.865509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:10.868334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:10.870003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bcda7018-3a34-43fa-89cb-67296eed0171 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1340 microversion: 2.20 time: 0.309642 Jul 12 22:06:10.874720 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 18/45] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:10 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1340 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:11.150976 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:11.163397 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4800d7a2-5e26-4c90-aa6c-9c9da47ed3a7 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.824940 Jul 12 22:06:11.187794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 28/46] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:10 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:11.237494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:11.238933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:11.251053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:11.252637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:11.262267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:11.264237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:11.435958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:11.453030 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00d9c23c-d7bb-4c9a-a525-cefd80984886 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1299 microversion: 2.1 time: 0.220109 Jul 12 22:06:11.454278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 19/47] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:11 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:11.893362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:11.895583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:11.905434 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:11.906283 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:11.908082 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:11.909710 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:12.192332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:12.194301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:12.250445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:12.259473 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:12.260334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:12.260800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:13.156454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:13.171163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b7a912d-8188-4487-b1a7-061a37cf0d90 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.986142 Jul 12 22:06:13.185266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 20/48] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:12 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:13.204022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:13.205159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:13.234363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:13.237374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:13.238521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:13.239252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:13.497122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:13.525361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:13.532789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:13.543178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a9d0dd3c-4c6f-4446-9634-658450d21f39 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 1.648051 Jul 12 22:06:13.562041 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 29/49] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:11 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:14.203858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:14.204543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:14.234614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:14.255323 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:14.256195 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:14.263528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:14.270352 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:14.271974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:14.272419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b6da6e22-734e-4e62-abef-f4f49add75e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 1.086060 Jul 12 22:06:14.280394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 21/50] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:13 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:14.568299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:14.569035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:14.616690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:14.620504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:14.624252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:14.625972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:14.888813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:14.913118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=16 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:15.608354 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:15.628357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:15.634824 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:15.641816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c0a347ce-40b0-426e-a8a5-f41881129644 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 1.078127 Jul 12 22:06:15.642408 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:15.651985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-290a1027-d9f7-4552-a452-b9a87dc12d53 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 1.453095 Jul 12 22:06:15.654627 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 22/51] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:14 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:15.662932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 30/52] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:14 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:15.688164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:15.692934 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:15.733783 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:15.733783 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:15.740581 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:15.744926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.118670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a2e45100-78b0-4416-b66d-c01d9539c3fb req-8adc9fc2-69d5-438a-84b9-473e79d8b597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "becadfba-d32d-4bdb-9086-685f70996a87", "tag": "c938efc5-5e53-4c1e-864c-947f327102ca"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:16.159530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a2e45100-78b0-4416-b66d-c01d9539c3fb req-8adc9fc2-69d5-438a-84b9-473e79d8b597 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.161027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a2e45100-78b0-4416-b66d-c01d9539c3fb req-8adc9fc2-69d5-438a-84b9-473e79d8b597 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.198281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a2e45100-78b0-4416-b66d-c01d9539c3fb req-8adc9fc2-69d5-438a-84b9-473e79d8b597 service nova] Creating event network-changed:c938efc5-5e53-4c1e-864c-947f327102ca for instance becadfba-d32d-4bdb-9086-685f70996a87 on hv-cinder-80295 Jul 12 22:06:16.204285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a2e45100-78b0-4416-b66d-c01d9539c3fb req-8adc9fc2-69d5-438a-84b9-473e79d8b597 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 22:06:16.204285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.205040 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.209949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.211810 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.256008 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.compute.rpcapi [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 22:06:16.258838 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] Releasing lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 22:06:16.280295 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=18 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:16.312199 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1bef0d8-fd4c-48b5-b847-5870380c7324 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.655839 Jul 12 22:06:16.313523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 23/53] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:16.662813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:16.667525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:16.682978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.685115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.687688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.689494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.834893 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:16.846901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-158a6550-fec8-45d5-8590-65690f1ab0f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 1.178909 Jul 12 22:06:16.857382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 31/54] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:15 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:16.863720 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:16.864558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:16.872651 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.873383 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:16.874318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:16.874911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:17.162936 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:17.164792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:17.178363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-27fa795c-c997-489b-bb4d-5da0cb9434ea tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.316006 Jul 12 22:06:17.178559 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:17.178674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 32/55] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:16 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:17.178754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:17.181007 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a143a3e7-00e6-4e0d-90e9-8601cb68b83d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.522871 Jul 12 22:06:17.191568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 24/56] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:16 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:17.414639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-020112f0-25a8-49e2-830a-4337b89e7402 req-9f50e3f7-6992-40b7-8e37-8f0da5d4b989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:17.428174 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-020112f0-25a8-49e2-830a-4337b89e7402 req-9f50e3f7-6992-40b7-8e37-8f0da5d4b989 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:17.428920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-020112f0-25a8-49e2-830a-4337b89e7402 req-9f50e3f7-6992-40b7-8e37-8f0da5d4b989 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:17.462585 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-020112f0-25a8-49e2-830a-4337b89e7402 req-9f50e3f7-6992-40b7-8e37-8f0da5d4b989 service nova] Creating event network-changed:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:06:17.464196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-020112f0-25a8-49e2-830a-4337b89e7402 req-9f50e3f7-6992-40b7-8e37-8f0da5d4b989 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117937) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 22:06:17.465744 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:17.466400 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:17.467665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:17.468187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:17.483693 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.compute.rpcapi [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 22:06:17.484737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] Releasing lock "compute-rpcapi-router" {{(pid=117937) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 22:06:17.541551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3e1c8ee4-690b-40ca-943d-d56b9a2700cc None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363237 Jul 12 22:06:17.542182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 33/57] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:17.872691 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:17.873358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:17.880650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:17.881169 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:17.881972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:17.882422 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:18.046479 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:18.057139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2ec7a956-d295-43ee-af5c-1c0d638ae907 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.196454 Jul 12 22:06:18.061388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 25/58] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:17 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:18.200444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:18.202162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:18.202964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:18.205075 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:18.217196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:18.217907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:18.219001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:18.219607 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:18.220385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:18.225637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:18.228984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:18.231351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:18.407044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:18.417965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:18.420989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:18.422139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a0325df1-2477-4a94-b482-7f166beef1e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.225699 Jul 12 22:06:18.422713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 26/59] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:18 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:18.492935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:18.501882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-91aeaa23-1de9-4030-a32d-3e02ac425b43 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.312171 Jul 12 22:06:18.511995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 34/60] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:18 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:19.077363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:19.078119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:19.100541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.102260 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.103630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.106810 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.366618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:19.377108 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b1dbc9f0-c989-495d-b753-202596fd31c3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.305419 Jul 12 22:06:19.378462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 27/61] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:19 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:19.442976 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:19.443930 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:19.458786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.459358 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.461095 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.461975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.522561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:19.522561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:19.535392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.536116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.537106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.538626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.858766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:19.870689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-94a7e81c-36a4-422b-b37b-babade88a74f tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.355731 Jul 12 22:06:19.879982 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 28/62] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:19 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:19.888822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-507c4860-c7f8-4b26-b164-8c9e0195502a req-f3b309e9-8521-49be-8ae8-62427ea59655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbee16d-55b1-4121-8fe2-023909bbef7c", "tag": "24cc7c40-57cc-4708-a7ec-372d6231f2a1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:19.906216 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:19.921382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:19.923259 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:19.924821 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-507c4860-c7f8-4b26-b164-8c9e0195502a req-f3b309e9-8521-49be-8ae8-62427ea59655 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:19.925573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-507c4860-c7f8-4b26-b164-8c9e0195502a req-f3b309e9-8521-49be-8ae8-62427ea59655 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:19.928586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f86cd6a9-1569-4a8b-8edd-6192e4447433 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.491299 Jul 12 22:06:19.942606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 35/63] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:19 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:19.953601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:19.956562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-507c4860-c7f8-4b26-b164-8c9e0195502a req-f3b309e9-8521-49be-8ae8-62427ea59655 service nova] Creating event network-changed:24cc7c40-57cc-4708-a7ec-372d6231f2a1 for instance acbee16d-55b1-4121-8fe2-023909bbef7c on hv-cinder-80295 Jul 12 22:06:19.962570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-507c4860-c7f8-4b26-b164-8c9e0195502a req-f3b309e9-8521-49be-8ae8-62427ea59655 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081292 Jul 12 22:06:19.963684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 29/64] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:20.397254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:20.398030 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:20.404692 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.405466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:20.408199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.408763 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:20.606758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:20.619992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7bf3a025-a15d-4e24-9826-b811f8b2d66b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.227305 Jul 12 22:06:20.621315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 36/65] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:20 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:20.893804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:20.894911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:20.915739 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.916492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:20.917506 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.918161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:20.954360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:20.958263 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:20.985787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.986409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:20.987595 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:20.989430 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:21.146862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:21.159053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8fef3fd-3943-459c-8d25-90b96123e413 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.274542 Jul 12 22:06:21.170218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 30/66] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:20 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:21.266199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:21.293111 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:21.294632 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:21.296209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0b9e84ea-7479-40fa-969d-1198901dc4ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.349548 Jul 12 22:06:21.300129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 37/67] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:20 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:21.638812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:21.639828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:21.649452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:21.649984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:21.651375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:21.651910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:21.803003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:21.811792 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3a890108-4b8d-48c5-b35d-6dfe5805c583 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.176619 Jul 12 22:06:21.812283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 31/68] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:21 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:22.176491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:22.177244 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:22.184101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.184546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:22.185442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.186214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:22.320909 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:22.321671 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:22.337824 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.338283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:22.339078 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.339521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:22.374812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:22.388559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2a048fec-7f8c-4bdf-b134-4cf6df22fac9 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.215555 Jul 12 22:06:22.396866 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 38/69] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:22 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:22.539862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:22.549592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:22.551561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:22.559882 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-adc80b83-babe-4b53-b6fb-97fae132b860 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.237098 Jul 12 22:06:22.560865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 32/70] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:22 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:22.829233 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:22.829960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:22.837213 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.837857 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:22.839410 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:22.839996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:23.013424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:23.023038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-00e391ec-746c-44fb-9853-4884ff28a368 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.197587 Jul 12 22:06:23.034087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 39/71] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:22 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:23.417131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:23.417752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:23.426188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:23.427119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:23.429071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:23.433867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:23.578837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:23.581146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:23.595277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:23.596022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:23.597132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:23.597803 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:23.621895 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:23.625033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=100 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:23.632125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d8f5862d-1291-41df-a040-714445667daf tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.220702 Jul 12 22:06:23.633301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 33/72] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:23 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:23.778596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:23.787673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:23.790283 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:23.791460 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a2fc8de6-46ab-4266-8039-7230d78bd9a1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.217421 Jul 12 22:06:23.792192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 40/73] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:23 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:24.041945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:24.043011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:24.051816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.052269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.053070 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.054558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.236730 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:24.245628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eb43f1ae-534c-4d48-8e1b-0646a0bad0d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.207765 Jul 12 22:06:24.246235 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 34/74] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:24 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:24.648973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:24.649589 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:24.655896 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.656327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.657174 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.657603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.805811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:24.810339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:24.811238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:24.814774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e623277d-167d-4e24-abab-d6a0ae2beb7d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.169556 Jul 12 22:06:24.815529 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 41/75] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:24 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:24.818115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.818567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.820322 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:24.820832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:24.975303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:24.983942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:24.985516 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:24.986625 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-20e1a7c0-e204-4a7a-b49b-d3aba67f06f4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.180449 Jul 12 22:06:24.987262 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 35/76] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:24 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:06:25.266889 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:25.267613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:25.287100 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:25.287816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:25.297705 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:25.298393 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:25.816640 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:25.834380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-249ac813-c551-4a2e-b5cf-d6a8a51b57eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.573851 Jul 12 22:06:25.835188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:25.837350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:25.840263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:25.848896 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 42/77] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:25 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:25.863885 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:25.864957 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:25.867928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:25.868772 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:26.004999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:26.006054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:26.017488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:26.024233 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:26.027761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:26.028859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:26.032606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:26.175056 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:26.184668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ba6cad2d-fa69-485a-962d-9a759fb35138 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.355557 Jul 12 22:06:26.187145 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 36/78] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:25 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:26.267305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:26.277255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:26.278963 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:26.280164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-da48d469-8b5f-4127-a29b-63f1833e3b3d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.279041 Jul 12 22:06:26.281008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 43/79] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:26 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:26.860662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:26.864271 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:26.871086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:26.873797 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:26.874442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:26.875226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:26.875834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.203391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:27.204831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:27.211706 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:27.212385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.213366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:27.213956 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.268129 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:27.277030 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e2160d25-2524-45ec-aa14-4390ad5d5fc0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.423177 Jul 12 22:06:27.295630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 37/80] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:26 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:27.311673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:27.312468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:27.325715 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:27.326601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.327404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:27.327881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.396981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:27.405942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-36056823-a600-4f8a-975c-decc452904de tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.206430 Jul 12 22:06:27.406828 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 44/81] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:27 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:27.551200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:27.603040 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:27.614811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:27.619101 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:27.623100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8a033e22-0c06-447b-abb9-4431d743580f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.326172 Jul 12 22:06:27.625814 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 38/82] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:27 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:27.646472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-b7c0fd70-b3c3-427d-9a92-7a49b1299ed0 req-6e142494-81e8-4e7f-b93a-a10b18bc7c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becadfba-d32d-4bdb-9086-685f70996a87", "name": "network-vif-plugged", "status": "completed", "tag": "c938efc5-5e53-4c1e-864c-947f327102ca"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:27.655583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-b7c0fd70-b3c3-427d-9a92-7a49b1299ed0 req-6e142494-81e8-4e7f-b93a-a10b18bc7c51 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:27.656030 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-b7c0fd70-b3c3-427d-9a92-7a49b1299ed0 req-6e142494-81e8-4e7f-b93a-a10b18bc7c51 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:27.677707 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-b7c0fd70-b3c3-427d-9a92-7a49b1299ed0 req-6e142494-81e8-4e7f-b93a-a10b18bc7c51 service nova] Creating event network-vif-plugged:c938efc5-5e53-4c1e-864c-947f327102ca for instance becadfba-d32d-4bdb-9086-685f70996a87 on hv-cinder-80295 Jul 12 22:06:27.685384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-b7c0fd70-b3c3-427d-9a92-7a49b1299ed0 req-6e142494-81e8-4e7f-b93a-a10b18bc7c51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133518 Jul 12 22:06:27.691982 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 45/83] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:06:28.297643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:28.300062 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:28.317367 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:28.320427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:28.324634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:28.326037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:28.424791 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:28.425654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:28.447164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:28.450274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:28.451648 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:28.453874 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:29.081420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:29.095371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d1d8fba-8b42-41db-b80b-9d15def6ad29 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.798219 Jul 12 22:06:29.096047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 39/84] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:28 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:29.102864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:29.109290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:29.127840 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:29.128438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:29.129480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:29.130060 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:29.220477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:29.229337 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4ed5be00-95f3-4ab8-8528-c084f511ad8d tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.809369 Jul 12 22:06:29.230606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 46/85] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:28 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:29.532881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:29.545269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:29.545269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:29.546078 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-70759767-25a4-4274-a818-dab5e2d61eb2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.448789 Jul 12 22:06:29.563619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 40/86] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:29 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:30.113168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:30.114825 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:30.123532 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.124468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.125517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.126214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.246414 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:30.247032 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:30.259127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.259624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.260977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.261321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.371313 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:30.381243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c7c6089b-8201-4fcd-b4d3-5047654c0450 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.273658 Jul 12 22:06:30.382121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:30 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:30.539066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:30.553211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-51a2f179-e045-4d39-b496-cbe6c107c795 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1315 microversion: 2.1 time: 0.310673 Jul 12 22:06:30.562825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 41/88] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:30 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:06:30.573731 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:30.574600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:30.592487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.593008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.593788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:30.594222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:30.867850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:30.879341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:30.880908 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:30.882801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e1158377-e1e0-4a7a-b2e9-14941e291deb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.312951 Jul 12 22:06:30.883356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 48/89] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:30 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:31.400389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:31.400547 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:31.419016 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.419820 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.420951 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.422654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.571815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:31.572338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:31.586653 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.587241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.588037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.588527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.618948 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:31.631963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d550f7d1-8c2f-45a3-8d35-a3bd4ae40f61 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.236879 Jul 12 22:06:31.644047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 42/90] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:31 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:31.667701 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-12b4a7eb-73e8-4e1a-91f5-f752620917de req-f13cc899-629c-45f1-bef4-dcb094dea500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbee16d-55b1-4121-8fe2-023909bbef7c", "name": "network-vif-plugged", "status": "completed", "tag": "24cc7c40-57cc-4708-a7ec-372d6231f2a1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:31.685687 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-12b4a7eb-73e8-4e1a-91f5-f752620917de req-f13cc899-629c-45f1-bef4-dcb094dea500 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.686348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-12b4a7eb-73e8-4e1a-91f5-f752620917de req-f13cc899-629c-45f1-bef4-dcb094dea500 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.712322 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-12b4a7eb-73e8-4e1a-91f5-f752620917de req-f13cc899-629c-45f1-bef4-dcb094dea500 service nova] Creating event network-vif-plugged:24cc7c40-57cc-4708-a7ec-372d6231f2a1 for instance acbee16d-55b1-4121-8fe2-023909bbef7c on hv-cinder-80295 Jul 12 22:06:31.728134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-12b4a7eb-73e8-4e1a-91f5-f752620917de req-f13cc899-629c-45f1-bef4-dcb094dea500 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064412 Jul 12 22:06:31.731089 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 43/91] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:06:31.856556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:31.869973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0c64cecf-f53c-4c8a-a550-f3927fdff37e tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1502 microversion: 2.1 time: 0.302605 Jul 12 22:06:31.873539 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 49/92] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:31 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:31.908758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:31.911758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:31.928684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.929834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:31.930907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:31.931492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:32.207170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:32.219718 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:32.219967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:32.221048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-03422bbe-6f0d-4271-8ace-a1fc7665892a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.319997 Jul 12 22:06:32.221628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 44/93] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:31 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:32.651492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:32.652103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:32.659647 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:32.660397 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:32.661276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:32.662054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:32.833463 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:32.842670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-dee641f5-8822-4fad-9e61-783d872bd689 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1366 microversion: 2.1 time: 0.195909 Jul 12 22:06:32.854333 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 50/94] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:32 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:33.244828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:33.245478 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:33.252841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.253404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.254219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.254662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.491225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:33.501080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:33.502608 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:33.503734 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00b9efb7-9137-4bc0-b932-e3e136b13d24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.268223 Jul 12 22:06:33.504299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 45/95] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:33 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:33.556365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237a40e1-0472-4b20-92fb-3d04c8e59d00"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:33.558757 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:33.580076 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.585319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.586932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.587937 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.758009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-722624c1-fe1c-4413-ab32-62693598079b req-a89854ed-f881-4d0d-88ed-85e2a86fc1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "name": "network-vif-plugged", "status": "completed", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:33.783447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-722624c1-fe1c-4413-ab32-62693598079b req-a89854ed-f881-4d0d-88ed-85e2a86fc1fd service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.784536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-722624c1-fe1c-4413-ab32-62693598079b req-a89854ed-f881-4d0d-88ed-85e2a86fc1fd service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.797309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-722624c1-fe1c-4413-ab32-62693598079b req-a89854ed-f881-4d0d-88ed-85e2a86fc1fd service nova] Creating event network-vif-plugged:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:06:33.803990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-722624c1-fe1c-4413-ab32-62693598079b req-a89854ed-f881-4d0d-88ed-85e2a86fc1fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049777 Jul 12 22:06:33.819675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 46/96] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:33.862142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:33.862519 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:33.881768 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.882222 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:33.883635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:33.884327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:34.087932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-473b52e7-a474-41fd-aa4a-93368b9a8bb5 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "POST /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537596 Jul 12 22:06:34.089298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 51/97] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:06:33 2022] POST /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:34.144376 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:34.148555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:34.158329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-62810669-4cef-4aa3-9898-17eb1d287300 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1555 microversion: 2.1 time: 0.301190 Jul 12 22:06:34.167211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 47/98] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:33 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1555 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:34.183369 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:34.183952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:34.195984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:34.196665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:34.197706 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:34.198575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:34.336350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5aa1ad72-8da9-4df7-93ee-a241febd71e0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161913 Jul 12 22:06:34.336940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 52/99] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:06:34 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:06:34.521886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:34.522472 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:34.531341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:34.533696 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:34.536598 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:34.537405 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:34.854497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:34.865578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:34.867926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:34.874293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ba44283f-a0ee-49f1-ac47-6f734ee70061 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1407 microversion: 2.20 time: 0.356434 Jul 12 22:06:34.885440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 48/100] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:34 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:35.893835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:35.895371 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:35.903386 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:35.903854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:35.905044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:35.905552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:36.157101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:36.166115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:36.173033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:36.175437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0c0a4592-5006-48be-9e28-d1354ef5edbb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1598 microversion: 2.20 time: 0.286390 Jul 12 22:06:36.177735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 53/101] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:06:35 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:06:36.199395 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:36.200325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:36.213661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:36.214112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:36.214992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:36.215448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:36.278917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-c7372bda-9f11-4bbe-b8de-2eae523538ae req-8852ac10-3e83-4a37-a108-12b76397377c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbee16d-55b1-4121-8fe2-023909bbef7c", "tag": "24cc7c40-57cc-4708-a7ec-372d6231f2a1"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:36.292172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c7372bda-9f11-4bbe-b8de-2eae523538ae req-8852ac10-3e83-4a37-a108-12b76397377c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:36.293980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c7372bda-9f11-4bbe-b8de-2eae523538ae req-8852ac10-3e83-4a37-a108-12b76397377c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:36.324533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-c7372bda-9f11-4bbe-b8de-2eae523538ae req-8852ac10-3e83-4a37-a108-12b76397377c service nova] Creating event network-changed:24cc7c40-57cc-4708-a7ec-372d6231f2a1 for instance acbee16d-55b1-4121-8fe2-023909bbef7c on hv-cinder-80295 Jul 12 22:06:36.338235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-c7372bda-9f11-4bbe-b8de-2eae523538ae req-8852ac10-3e83-4a37-a108-12b76397377c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059525 Jul 12 22:06:36.342524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 54/102] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:36.430296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9942bb5e-4dc2-435d-99a0-0f9b3ef9c812 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.236791 Jul 12 22:06:36.431369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 49/103] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jul 12 22:06:36 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:06:39.107713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-90e2fc89-1b62-451c-a438-53a1689fc551 req-0716489f-0132-42ca-8b9b-74813adca98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:39.118603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-90e2fc89-1b62-451c-a438-53a1689fc551 req-0716489f-0132-42ca-8b9b-74813adca98a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:39.119147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-90e2fc89-1b62-451c-a438-53a1689fc551 req-0716489f-0132-42ca-8b9b-74813adca98a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:39.141679 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-90e2fc89-1b62-451c-a438-53a1689fc551 req-0716489f-0132-42ca-8b9b-74813adca98a service nova] Creating event network-changed:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:06:39.148111 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-90e2fc89-1b62-451c-a438-53a1689fc551 req-0716489f-0132-42ca-8b9b-74813adca98a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046708 Jul 12 22:06:39.149500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 55/104] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:06:48.597076 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=27 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:48.597827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=10 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:48.603746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:48.605603 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:48.621609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:48.622072 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:48.622866 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:48.624785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:48.669239 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:06:48.827721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd537718-cebb-4cc0-beb6-e35006cd36d4 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 204 len: 0 microversion: 2.1 time: 0.230381 Jul 12 22:06:48.828348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 50/105] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:06:48 2022] DELETE /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:06:48.840747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:48.841458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:48.866750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:48.870699 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:48.872808 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:48.873477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:49.126426 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:49.135951 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-817529b9-f364-413a-b44e-7ce136f9875b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1554 microversion: 2.1 time: 0.302659 Jul 12 22:06:49.139302 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 56/106] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:48 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:50.160110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:50.160892 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:50.168457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:50.169807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:50.172130 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:50.172846 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:50.360688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:50.372763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f5e56fdd-bee2-45d3-b6ed-50602a14c2df tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1554 microversion: 2.1 time: 0.218267 Jul 12 22:06:50.373651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 51/107] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:50 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:51.391761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:51.392381 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:51.410084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:51.411036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:51.412793 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:51.413833 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:51.665787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:51.680404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3f319b5e-8f2d-465a-b274-3c9c05b9dac6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1554 microversion: 2.1 time: 0.293064 Jul 12 22:06:51.681415 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 57/108] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:51 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1554 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:52.238082 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-4f48ce2d-ec1b-40c9-be02-a8e8cf1cd588 req-d616b563-2120-4f04-af62-fb8ca557e385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becadfba-d32d-4bdb-9086-685f70996a87", "name": "network-vif-deleted", "tag": "c938efc5-5e53-4c1e-864c-947f327102ca"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:52.249522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4f48ce2d-ec1b-40c9-be02-a8e8cf1cd588 req-d616b563-2120-4f04-af62-fb8ca557e385 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:52.250003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4f48ce2d-ec1b-40c9-be02-a8e8cf1cd588 req-d616b563-2120-4f04-af62-fb8ca557e385 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:52.265533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-4f48ce2d-ec1b-40c9-be02-a8e8cf1cd588 req-d616b563-2120-4f04-af62-fb8ca557e385 service nova] Creating event network-vif-deleted:c938efc5-5e53-4c1e-864c-947f327102ca for instance becadfba-d32d-4bdb-9086-685f70996a87 on hv-cinder-80295 Jul 12 22:06:52.271963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-4f48ce2d-ec1b-40c9-be02-a8e8cf1cd588 req-d616b563-2120-4f04-af62-fb8ca557e385 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037279 Jul 12 22:06:52.273219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 52/109] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:06:52.699444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:52.699983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:52.706512 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:52.706960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:52.707725 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:52.708160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:52.712572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:52.745524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:52.745971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:52.746430 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lazy-loading 'fault' on Instance uuid becadfba-d32d-4bdb-9086-685f70996a87 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:06:52.790442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf13eeff770b406796ab7008b8429637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc783af528d4cd2a2b05519449924d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:52.798518 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7882b317-9926-4ef6-bcbd-39ed7fa8d91b tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 200 len: 1351 microversion: 2.1 time: 0.103070 Jul 12 22:06:52.799097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 58/110] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:52 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:52.918491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-339105422", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "networks": [{"uuid": "31ac3518-de75-4977-a222-6d4452964554"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:52.999245 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] validate_networks() for [('31ac3518-de75-4977-a222-6d4452964554', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:06:53.395049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:06:53.395671 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:06:53.395942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:06:53.396351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:06:53.397159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:06:53.407048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.407578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.408378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.408849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.427093 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Getting quotas for project 304ae4bdbbf74ec9896a31d1f72ed72a. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:06:53.432114 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Getting quotas for user 64f97c33dcc74dd4ad69c277415f4643 and project 304ae4bdbbf74ec9896a31d1f72ed72a. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:06:53.444793 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:06:53.447606 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:06:53.519276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3671bd62-ceef-4ea1-a16b-88af6826d909 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614269 Jul 12 22:06:53.520303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 53/111] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:06:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:06:53.531214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d4f9dc7a-af93-4ebd-9094-fefefc791665 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:53.532106 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d4f9dc7a-af93-4ebd-9094-fefefc791665 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:53.596165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d4f9dc7a-af93-4ebd-9094-fefefc791665 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:53.605225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d4f9dc7a-af93-4ebd-9094-fefefc791665 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1213 microversion: 2.1 time: 0.078032 Jul 12 22:06:53.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 59/112] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:53 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:53.816068 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:53.816903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:53.824694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.825167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.825934 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.826361 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.840956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] HTTP exception thrown: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Request method failure captured: Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 HTTP/1.1 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBG7zjQN4hL0DfUqyIFy370lEbAsTgaw-YkcIUsWukFBUYV74x2ixxlbowhKXLqCjNbUvmR2LMaizwcAY7_U7Wyc_47cXkydcrPZbc9fL5KnjfoIjqP5CuCTjqpWtCo1cO1XUNRQfChnzfxD9Y1aBIt4Q9ytQkJemLNZVeQUHczHcE Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:06:53.845666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: bf13eeff770b406796ab7008b8429637 Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.847198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'becadfba-d32d-4bdb-9086-685f70996a87'} Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:53.847887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.849012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.850047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Returning 404 to user: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:53.850047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-851eb42e-3c46-4d53-b6d0-df2cf229c40a tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 404 len: 111 microversion: 2.1 time: 0.035026 Jul 12 22:06:53.850047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 54/113] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:53 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:06:53.964089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:53.965548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:53.973839 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.974702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.976413 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:53.977138 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:53.991214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] HTTP exception thrown: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Request method failure captured: Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87/os-volume_attachments HTTP/1.1 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBG7zjQN4hL0DfUqyIFy370lEbAsTgaw-YkcIUsWukFBUYV74x2ixxlbowhKXLqCjNbUvmR2LMaizwcAY7_U7Wyc_47cXkydcrPZbc9fL5KnjfoIjqP5CuCTjqpWtCo1cO1XUNRQfChnzfxD9Y1aBIt4Q9ytQkJemLNZVeQUHczHcE Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:53.995688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: bf13eeff770b406796ab7008b8429637 Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.996978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'server_id': 'becadfba-d32d-4bdb-9086-685f70996a87'} Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:53.997671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:53.998799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:53.999867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Returning 404 to user: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:53.999867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-de2be4ed-bd1a-4bf2-9784-0300f5bc93e6 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043991 Jul 12 22:06:53.999867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 60/114] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:06:53 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:06:54.628180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:54.629860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:54.637505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:54.638331 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:54.639306 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:54.640081 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:54.728847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:54.747658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0c2ea2e3-3ed3-4467-9652-e125dfca8a48 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1273 microversion: 2.1 time: 0.124954 Jul 12 22:06:54.748238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 55/115] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:54 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:55.234545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:55.235055 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:55.242011 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.242474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.243265 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.243688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.258072 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] HTTP exception thrown: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Request method failure captured: Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 HTTP/1.1 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBG7zjQN4hL0DfUqyIFy370lEbAsTgaw-YkcIUsWukFBUYV74x2ixxlbowhKXLqCjNbUvmR2LMaizwcAY7_U7Wyc_47cXkydcrPZbc9fL5KnjfoIjqP5CuCTjqpWtCo1cO1XUNRQfChnzfxD9Y1aBIt4Q9ytQkJemLNZVeQUHczHcE Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:06:55.260183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: bf13eeff770b406796ab7008b8429637 Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.261420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'becadfba-d32d-4bdb-9086-685f70996a87'} Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:55.262058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.263120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.264226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Returning 404 to user: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:55.264226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f3fc0d64-ec9d-48dc-a0f9-006daecd0ec1 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 404 len: 111 microversion: 2.1 time: 0.031072 Jul 12 22:06:55.264226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 61/116] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:06:55 2022] DELETE /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:06:55.270588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:55.271197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] [instance: becadfba-d32d-4bdb-9086-685f70996a87] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:55.277878 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.278323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.279073 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.279497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.293085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] HTTP exception thrown: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Request method failure captured: Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 HTTP/1.1 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBG7zjQN4hL0DfUqyIFy370lEbAsTgaw-YkcIUsWukFBUYV74x2ixxlbowhKXLqCjNbUvmR2LMaizwcAY7_U7Wyc_47cXkydcrPZbc9fL5KnjfoIjqP5CuCTjqpWtCo1cO1XUNRQfChnzfxD9Y1aBIt4Q9ytQkJemLNZVeQUHczHcE Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:06:55.294620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bdc783af528d4cd2a2b05519449924d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: bdc783af528d4cd2a2b05519449924d9 Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-DeleteServersTestJSON-1451871241 Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: bf13eeff770b406796ab7008b8429637 Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-DeleteServersTestJSON-1451871241-project Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.295898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'becadfba-d32d-4bdb-9086-685f70996a87'} Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:06:55.296525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. Jul 12 22:06:55.297570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:06:55.298507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] Returning 404 to user: Instance becadfba-d32d-4bdb-9086-685f70996a87 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:06:55.298507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2228877d-a3c7-4deb-b132-cd22b931fe97 tempest-DeleteServersTestJSON-1451871241 tempest-DeleteServersTestJSON-1451871241-project] 10.222.0.44 "GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87" status: 404 len: 111 microversion: 2.1 time: 0.029271 Jul 12 22:06:55.298507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 56/117] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:55 2022] GET /compute/v2.1/servers/becadfba-d32d-4bdb-9086-685f70996a87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:06:55.767724 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:55.768448 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:55.776469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.776948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.777935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:55.778389 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:55.932244 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:55.941168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-73cce11e-d05e-4515-ae98-044a06d6bde9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.177452 Jul 12 22:06:55.941875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 62/118] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:55 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:56.961672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:56.963682 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:56.979317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:56.979775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:56.980548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:56.981018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:57.248143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:57.262001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-313ea7e7-11ff-494e-bfdc-689f51ad7486 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.305285 Jul 12 22:06:57.263576 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 57/119] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:56 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:57.863068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-32b28635-12b4-4c1a-99e8-f389e197c60c req-e824ee78-5551-4b90-9569-ed1f8d21ae8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9865cf-0406-458d-9e4d-69838d82eb65", "tag": "cef49d00-28a9-4721-9b63-fe521c26d0c3"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:06:57.867135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=44 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:06:57.873719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-32b28635-12b4-4c1a-99e8-f389e197c60c req-e824ee78-5551-4b90-9569-ed1f8d21ae8a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:57.874168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-32b28635-12b4-4c1a-99e8-f389e197c60c req-e824ee78-5551-4b90-9569-ed1f8d21ae8a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:57.892086 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-32b28635-12b4-4c1a-99e8-f389e197c60c req-e824ee78-5551-4b90-9569-ed1f8d21ae8a service nova] Creating event network-changed:cef49d00-28a9-4721-9b63-fe521c26d0c3 for instance 7e9865cf-0406-458d-9e4d-69838d82eb65 on hv-cinder-80295 Jul 12 22:06:57.897632 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-32b28635-12b4-4c1a-99e8-f389e197c60c req-e824ee78-5551-4b90-9569-ed1f8d21ae8a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037797 Jul 12 22:06:57.898235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 63/120] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:06:58.280281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:58.280926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:58.287624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:58.288411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:58.289388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:58.289827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:58.607325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:58.614972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ad0f582-50be-466a-9245-71248dba00e1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.339222 Jul 12 22:06:58.615691 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 58/121] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:58 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:06:59.634579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:06:59.635214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:06:59.641738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:59.642190 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:59.642971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:06:59.643404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:06:59.846417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:06:59.852958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2ed9eabc-4af4-4cb1-8150-4295915d6d97 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.223024 Jul 12 22:06:59.857115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 64/122] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:06:59 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:00.869816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:00.870433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:00.876980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:00.877424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:00.878198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:00.878764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:01.072111 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:01.081031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b91ade03-545e-4cde-a6b9-4ed10a765738 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.214829 Jul 12 22:07:01.081613 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 59/123] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:00 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:02.099229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:02.101225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:02.114938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:02.116026 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:02.117479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:02.121850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:02.461335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:02.480298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3e7e730e-cd98-460f-be4c-13edb9ee52e8 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.386198 Jul 12 22:07:02.482162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 65/124] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:02 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:03.499723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:03.500234 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:03.506582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:03.507539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:03.519436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:03.521035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:03.523367 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:03.524544 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:03.710657 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:03.720087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-03e67dc9-e0e1-4104-87f8-a3685d5f6878 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.224306 Jul 12 22:07:03.732871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 60/125] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:03 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:04.738196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:04.738802 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:04.741569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:04.747341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:04.747790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:04.752541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:04.753089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:05.047365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:05.058255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5052a617-0a0a-4e48-be00-e2a8395270f7 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.323855 Jul 12 22:07:05.059004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 66/126] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:04 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:05.619415 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e712cabf-60e3-4499-9f89-d9b8e1f5816b req-8eb36de3-cab3-4074-bcf4-e09803d7caa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9865cf-0406-458d-9e4d-69838d82eb65", "name": "network-vif-plugged", "status": "completed", "tag": "cef49d00-28a9-4721-9b63-fe521c26d0c3"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:05.632676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e712cabf-60e3-4499-9f89-d9b8e1f5816b req-8eb36de3-cab3-4074-bcf4-e09803d7caa1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:05.633522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e712cabf-60e3-4499-9f89-d9b8e1f5816b req-8eb36de3-cab3-4074-bcf4-e09803d7caa1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:05.649977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e712cabf-60e3-4499-9f89-d9b8e1f5816b req-8eb36de3-cab3-4074-bcf4-e09803d7caa1 service nova] Creating event network-vif-plugged:cef49d00-28a9-4721-9b63-fe521c26d0c3 for instance 7e9865cf-0406-458d-9e4d-69838d82eb65 on hv-cinder-80295 Jul 12 22:07:05.658476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e712cabf-60e3-4499-9f89-d9b8e1f5816b req-8eb36de3-cab3-4074-bcf4-e09803d7caa1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045380 Jul 12 22:07:05.659391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 61/127] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:06.077334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:06.078658 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:06.088605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:06.089542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:06.090568 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:06.091218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:06.420760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:06.437669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-54531da3-aae1-4674-8248-6abc3d5aedf0 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.365292 Jul 12 22:07:06.439619 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 67/128] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:06 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:07.284218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1484120691", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:07.351052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] validate_networks() for [('acfecc3c-2e76-4d1d-82a2-18082fba1111', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:07:07.456889 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:07.458134 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:07.465777 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:07.466228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:07.467121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:07.467558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:07.616479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:07.628497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-51be8905-5d3e-4fe7-8cdb-01bb55adbccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.175674 Jul 12 22:07:07.629241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 68/129] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:07 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:08.026438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:07:08.029581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:07:08.030270 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:07:08.030830 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:07:08.031398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:07:08.057875 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:08.058504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:08.059488 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:08.060083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:08.089922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:07:08.095226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for user 309de655c8d64223a9c2d75ff5618411 and project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:07:08.108272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:07:08.111225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:07:08.173941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8ed693b3-6ca9-454a-91c8-c613df155658 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.150712 Jul 12 22:07:08.176172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 62/130] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:07:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:07:08.186259 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d8427de3-cda8-404e-b96a-ec7853b8741c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:08.187066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d8427de3-cda8-404e-b96a-ec7853b8741c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:08.275966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d8427de3-cda8-404e-b96a-ec7853b8741c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:08.285214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d8427de3-cda8-404e-b96a-ec7853b8741c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1222 microversion: 2.1 time: 0.102523 Jul 12 22:07:08.296793 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 69/131] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:08 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:08.391526 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1439333636", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:08.497805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] validate_networks() for [('acfecc3c-2e76-4d1d-82a2-18082fba1111', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:07:08.648038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:08.652900 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:08.660852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:08.661423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:08.663061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:08.665308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:08.887167 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:08.895336 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1ab9c764-4040-413f-891c-78456b37ee3b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.251704 Jul 12 22:07:08.895918 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 70/132] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:08 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:08.988597 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:07:08.989213 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:07:08.989700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:07:08.990462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:07:08.991053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:07:08.999978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:09.000546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:09.001375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:09.001808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:09.019668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:07:09.024418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for user 309de655c8d64223a9c2d75ff5618411 and project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:07:09.035352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:07:09.038155 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:07:09.081261 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5dcbe9ae-428c-46ca-8538-5b047bdb0da4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.694854 Jul 12 22:07:09.081919 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 63/133] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:07:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:07:09.092447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8df708f6-7a61-45b1-b390-b4950e49c0a3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:09.093107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8df708f6-7a61-45b1-b390-b4950e49c0a3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:09.149545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8df708f6-7a61-45b1-b390-b4950e49c0a3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:09.156092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8df708f6-7a61-45b1-b390-b4950e49c0a3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1222 microversion: 2.1 time: 0.067441 Jul 12 22:07:09.156657 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 71/134] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:09 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:09.914046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:09.914758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:09.924294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:09.924862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:09.925721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:09.926193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:10.103069 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:10.117199 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-991b55c1-102f-4686-b1e8-d8815904ac85 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.207870 Jul 12 22:07:10.130121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 64/135] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:09 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:10.172614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:10.173617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:10.181928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:10.182472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:10.183363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:10.183904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:10.246117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:10.253556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b77c81cb-27bd-4564-bfd3-19688b73d7e0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1226 microversion: 2.1 time: 0.085177 Jul 12 22:07:10.254130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 72/136] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:10 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:11.152057 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:11.153467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:11.166404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:11.167426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:11.169258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:11.170381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:11.273798 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:11.274804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:11.282490 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:11.283217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:11.284102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:11.284628 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:11.348169 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:11.356913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:11.357249 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-84b7ff7d-1fd5-41d5-beb7-e381342571c2 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1313 microversion: 2.1 time: 0.213497 Jul 12 22:07:11.358162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 65/137] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:11 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:11.371304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ca59149d-1b2f-4da7-a9c8-10daf41fd3c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1218 microversion: 2.1 time: 0.103810 Jul 12 22:07:11.371937 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 73/138] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:11 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:12.374925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:12.378251 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:12.388404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:12.389267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:12.390122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:12.390738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:12.391738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:12.392611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:12.405330 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:12.405685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:12.406494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:12.406990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:12.559098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:12.574574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a72af988-6dbc-415e-97b6-792fb794831e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1282 microversion: 2.1 time: 0.185892 Jul 12 22:07:12.576622 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 74/139] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:12 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:12.664077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:12.674283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4af03391-7f58-4c39-93da-708e192289b3 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1496 microversion: 2.1 time: 0.303014 Jul 12 22:07:12.675192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 66/140] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:12 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1496 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:13.223541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:13.224276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:13.231148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.231937 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.232941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.233446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.263451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:07:13.469407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c364a4c6-a89e-4b65-9e43-b39e9d34f8e9 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 204 len: 0 microversion: 2.1 time: 0.249445 Jul 12 22:07:13.470921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 75/141] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:07:13 2022] DELETE /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:07:13.480469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:13.481892 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:13.489645 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.491086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.492106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.492818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.596143 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:13.598949 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:13.609210 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.610019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.611203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:13.612506 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:13.746596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:13.761831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aeb0515b-7a1c-4345-ad3b-937852fbb01b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1280 microversion: 2.1 time: 0.170943 Jul 12 22:07:13.762944 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 76/142] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:13 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:13.921875 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:13.930723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0a91421-5154-49a0-aed5-939f867b0d46 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1502 microversion: 2.1 time: 0.455310 Jul 12 22:07:13.941019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 67/143] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:13 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1502 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:14.333829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-184540b0-c684-4889-8969-312d8f209ef9 req-d47ae66e-dc17-4b93-8c1b-f587cb1e9dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f13d7c-c02d-4b72-90d6-8f7703ffd21c", "tag": "24b248d6-9626-4883-9d64-eb804e2a6c97"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:14.361439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-184540b0-c684-4889-8969-312d8f209ef9 req-d47ae66e-dc17-4b93-8c1b-f587cb1e9dd5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:14.361962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-184540b0-c684-4889-8969-312d8f209ef9 req-d47ae66e-dc17-4b93-8c1b-f587cb1e9dd5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:14.382995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-184540b0-c684-4889-8969-312d8f209ef9 req-d47ae66e-dc17-4b93-8c1b-f587cb1e9dd5 service nova] Creating event network-changed:24b248d6-9626-4883-9d64-eb804e2a6c97 for instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c on hv-cinder-80295 Jul 12 22:07:14.390551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-184540b0-c684-4889-8969-312d8f209ef9 req-d47ae66e-dc17-4b93-8c1b-f587cb1e9dd5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065327 Jul 12 22:07:14.391941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 77/144] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:14.779632 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:14.780871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:14.788785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:14.789483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:14.790664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:14.791100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:14.951525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:14.952236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:14.967948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:14.968666 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:14.970824 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:14.973153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:14.997295 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:15.174679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:15.195076 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b98026b6-db63-45c1-b768-08c0dcf23bdc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.417134 Jul 12 22:07:15.207020 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 68/145] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:14 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:15.243904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:15.254725 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-192b156b-f110-43f1-ba7d-8218429a1b17 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1502 microversion: 2.1 time: 0.310233 Jul 12 22:07:15.264814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 78/146] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:14 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:16.218548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:16.219284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:16.226386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:16.227106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:16.227679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:16.228204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:16.247024 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:16.273155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:16.275393 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:16.282809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:16.283382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:16.284288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:16.284867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:16.368702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:16.389916 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-099fd375-8df8-4203-959f-b395e642827b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1460 microversion: 2.1 time: 0.120295 Jul 12 22:07:16.399755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 79/147] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:16 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1460 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:16.410522 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-40d870c8-3817-463a-8b94-e35e2fc8cc86 req-f9654399-ec06-49ce-8b6c-7882cd68a30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9865cf-0406-458d-9e4d-69838d82eb65", "name": "network-vif-deleted", "tag": "cef49d00-28a9-4721-9b63-fe521c26d0c3"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:16.450556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-40d870c8-3817-463a-8b94-e35e2fc8cc86 req-f9654399-ec06-49ce-8b6c-7882cd68a30b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:16.460484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-40d870c8-3817-463a-8b94-e35e2fc8cc86 req-f9654399-ec06-49ce-8b6c-7882cd68a30b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:16.467689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-40d870c8-3817-463a-8b94-e35e2fc8cc86 req-f9654399-ec06-49ce-8b6c-7882cd68a30b service nova] Creating event network-vif-deleted:cef49d00-28a9-4721-9b63-fe521c26d0c3 for instance 7e9865cf-0406-458d-9e4d-69838d82eb65 on hv-cinder-80295 Jul 12 22:07:16.476341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-40d870c8-3817-463a-8b94-e35e2fc8cc86 req-f9654399-ec06-49ce-8b6c-7882cd68a30b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071897 Jul 12 22:07:16.477169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 80/148] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:16.509119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:16.519530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-12405384-ca76-41a7-8393-e3d774ba0504 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.304740 Jul 12 22:07:16.520142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 69/149] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:16 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:17.408772 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:17.409169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:17.415833 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:17.416517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:17.417544 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:17.418118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:17.497852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:17.506101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ad9f9b5c-7006-4498-8f3d-c998d25edcdc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1460 microversion: 2.1 time: 0.101940 Jul 12 22:07:17.506704 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 81/150] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:17 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1460 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:17.537189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:17.537805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:17.543796 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:17.544243 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:17.545036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:17.545518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:17.686648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:17.695970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-09ae2080-2182-4a92-8135-b23956562c31 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.162758 Jul 12 22:07:17.696580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 70/151] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:17 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:18.496154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-9d85e025-ef39-4d7d-a261-6f16037d2188 req-d1ea187d-3ff2-473c-a655-e12191367aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca7f2f6-f0de-44d2-9f95-a04ba894bc66", "tag": "91661900-db83-420e-9017-4dd79576f7e7"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:18.505045 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9d85e025-ef39-4d7d-a261-6f16037d2188 req-d1ea187d-3ff2-473c-a655-e12191367aef service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:18.505568 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9d85e025-ef39-4d7d-a261-6f16037d2188 req-d1ea187d-3ff2-473c-a655-e12191367aef service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:18.516814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-9d85e025-ef39-4d7d-a261-6f16037d2188 req-d1ea187d-3ff2-473c-a655-e12191367aef service nova] Creating event network-changed:91661900-db83-420e-9017-4dd79576f7e7 for instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 on hv-cinder-80295 Jul 12 22:07:18.523165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-9d85e025-ef39-4d7d-a261-6f16037d2188 req-d1ea187d-3ff2-473c-a655-e12191367aef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030159 Jul 12 22:07:18.523957 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:18.524290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 82/152] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:18.524728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:18.531669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:18.532193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:18.533140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:18.533648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:18.596633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:18.604578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5c88473d-cce2-4e6f-aa9b-eb141d5d7f2e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 200 len: 1460 microversion: 2.1 time: 0.085221 Jul 12 22:07:18.605205 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 71/153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:18 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:18.713775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:18.714561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:18.721305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:18.721898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:18.722693 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:18.723228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:18.886962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:18.894898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2059d780-02d4-4a43-85ee-3b1abffa5851 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.185906 Jul 12 22:07:18.895358 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 83/154] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:18 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:19.307303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-75214995", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "networks": [{"uuid": "4ef1159c-69e5-41f7-9915-a0e86e879149"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:19.314530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:19.315238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=12 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:19.316019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:19.364283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] validate_networks() for [('4ef1159c-69e5-41f7-9915-a0e86e879149', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:07:19.622809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:19.623411 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: 7e9865cf-0406-458d-9e4d-69838d82eb65] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:19.625528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:19.632676 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:19.633260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:19.634036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:19.634476 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:19.649971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] HTTP exception thrown: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Request method failure captured: Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 HTTP/1.1 Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfB7_x_9SJIDtquKy2F1oHdWDN7bQbwWfppOwQFbnD65ZjvrJtpUxQUpi3WnrMnQspXdfQRPMVK5jmOnQH5jM8vpPVgoxD_JUMSrRpcCTeAN3nnKRH-8Q6LXSEBN_1GmC6O2UUSwbd1LiJTmBGO-Ep8hEWYbX-0-iDn8KDYLrQpTX2U Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 304ae4bdbbf74ec9896a31d1f72ed72a Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesActionsTest-690534395 Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:07:19.651884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesActionsTest-690534395 Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 304ae4bdbbf74ec9896a31d1f72ed72a Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesActionsTest-690534395 Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesActionsTest-690534395-project Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 64f97c33dcc74dd4ad69c277415f4643 Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesActionsTest-690534395-project Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. Jul 12 22:07:19.653498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '7e9865cf-0406-458d-9e4d-69838d82eb65'} Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:07:19.654384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. Jul 12 22:07:19.655760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:07:19.657852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Returning 404 to user: Instance 7e9865cf-0406-458d-9e4d-69838d82eb65 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:07:19.658709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5eea720e-ee0d-44ff-8625-446d4539d2ad tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65" status: 404 len: 111 microversion: 2.1 time: 0.039862 Jul 12 22:07:19.660779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 84/155] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:19 2022] GET /compute/v2.1/servers/7e9865cf-0406-458d-9e4d-69838d82eb65 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:07:19.769739 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-184938958", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "networks": [{"uuid": "31ac3518-de75-4977-a222-6d4452964554"}]}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:19.827186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] validate_networks() for [('31ac3518-de75-4977-a222-6d4452964554', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:07:19.936818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:07:19.937299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:07:19.937706 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:07:19.938111 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:07:19.939095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:07:19.949488 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:19.950307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:19.951409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:19.952031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:19.985670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Getting quotas for project 39f88660bffb4d17ba8b5a7a00c3f6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:07:19.990392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Getting quotas for user 4c137f9412de4914b77732e1ac29ec36 and project 39f88660bffb4d17ba8b5a7a00c3f6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:07:20.002382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:07:20.004868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:07:20.054180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9b196b55-cb7d-47a3-b95c-d7ce0e0fee20 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751664 Jul 12 22:07:20.054832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 72/156] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:07:20.059313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:20.059938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:20.066608 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:20.067061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:20.067832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:20.068309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:20.256734 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:20.275403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1d46b109-93cc-48b5-9391-defc6581739b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.219510 Jul 12 22:07:20.276473 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 73/157] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:20 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:20.282002 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:07:20.282646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:07:20.283257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:07:20.283905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-14f94ff8-3d65-4325-b73d-2f91263f116e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:20.284189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:07:20.284813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:07:20.285263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-14f94ff8-3d65-4325-b73d-2f91263f116e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:20.296980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:20.297623 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:20.298567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:20.299160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:20.318060 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Getting quotas for project 304ae4bdbbf74ec9896a31d1f72ed72a. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:07:20.323761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Getting quotas for user 64f97c33dcc74dd4ad69c277415f4643 and project 304ae4bdbbf74ec9896a31d1f72ed72a. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:07:20.338938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:07:20.341758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:07:20.366600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-14f94ff8-3d65-4325-b73d-2f91263f116e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:20.383533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-14f94ff8-3d65-4325-b73d-2f91263f116e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1217 microversion: 2.1 time: 0.104558 Jul 12 22:07:20.384121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 74/158] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:20 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:20.400531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-12dded5a-cd7f-4ce8-9c9f-d9ebd722fccd tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634174 Jul 12 22:07:20.401955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 85/159] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 22:07:20.416399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-39dfbc58-562d-4c2e-b8ba-e27dfbd65f94 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:20.418600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-39dfbc58-562d-4c2e-b8ba-e27dfbd65f94 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:20.552915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-39dfbc58-562d-4c2e-b8ba-e27dfbd65f94 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:20.562268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-39dfbc58-562d-4c2e-b8ba-e27dfbd65f94 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1213 microversion: 2.1 time: 0.152910 Jul 12 22:07:20.563053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 75/160] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:20 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:21.295439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:21.296058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:21.309913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.311960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.313906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.314321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.401336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:21.402104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:21.415734 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.416186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.417012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.417419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.481967 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:21.490177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4f776678-49b9-498c-8844-b1c4f278ef18 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.199611 Jul 12 22:07:21.491285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 86/161] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:21 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:21.505676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:21.514852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c7925b4-8863-46df-8757-47c1b72511a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1287 microversion: 2.1 time: 0.118001 Jul 12 22:07:21.515445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 76/162] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:21 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:21.579324 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:21.580064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:21.586207 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.586860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.587630 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:21.588067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:21.655042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:21.665908 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-98135fca-12fd-417f-854e-3944bed26976 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1265 microversion: 2.1 time: 0.090355 Jul 12 22:07:21.676241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 87/163] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:21 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:22.518192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:22.520703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:22.528692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.529260 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.530527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.531299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.532973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:22.533801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:22.544474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.544953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.547570 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.549136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.801839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:22.812085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-837284ff-b569-4f2e-ab6b-0b32f5968cf6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.308261 Jul 12 22:07:22.817046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 77/164] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:22 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:22.822285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:22.823287 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:22.830939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.831754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.832854 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:22.833564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:22.842838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:22.853846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2c23d42e-a2d7-42e9-836b-cd07d85437ab tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.325741 Jul 12 22:07:22.856134 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 88/165] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:22 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:23.158001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:23.165591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ec3a63d-7327-4214-8500-bddcb4b69070 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.347388 Jul 12 22:07:23.169169 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 78/166] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:22 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:23.789989 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-557543c1-fc30-40d3-8bfa-88fc5de4cadf req-78cf1169-4bfb-43dc-951f-bdcf4a45ed22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5765237-b68a-4285-895c-fb868aba4c8b", "tag": "e51faae8-807d-4876-9c92-2f59ecea3378"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:23.813820 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-557543c1-fc30-40d3-8bfa-88fc5de4cadf req-78cf1169-4bfb-43dc-951f-bdcf4a45ed22 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.814258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-557543c1-fc30-40d3-8bfa-88fc5de4cadf req-78cf1169-4bfb-43dc-951f-bdcf4a45ed22 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:23.829046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:23.830259 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:23.841512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.845179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:23.846096 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.846607 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:23.851143 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-557543c1-fc30-40d3-8bfa-88fc5de4cadf req-78cf1169-4bfb-43dc-951f-bdcf4a45ed22 service nova] Creating event network-changed:e51faae8-807d-4876-9c92-2f59ecea3378 for instance a5765237-b68a-4285-895c-fb868aba4c8b on hv-cinder-80295 Jul 12 22:07:23.859409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-557543c1-fc30-40d3-8bfa-88fc5de4cadf req-78cf1169-4bfb-43dc-951f-bdcf4a45ed22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073603 Jul 12 22:07:23.864229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 89/167] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:23.899295 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-80cd9df6-6d45-4745-9c4b-79506a8658f7 req-c36eea3b-7f75-4efc-957c-06ccce5c1c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7e86a8-1d55-4bb8-a02c-344f8e974058", "tag": "6ee11d09-9d61-424f-b809-00e67450dab4"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:23.923244 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-80cd9df6-6d45-4745-9c4b-79506a8658f7 req-c36eea3b-7f75-4efc-957c-06ccce5c1c37 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.924014 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-80cd9df6-6d45-4745-9c4b-79506a8658f7 req-c36eea3b-7f75-4efc-957c-06ccce5c1c37 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:23.948386 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-80cd9df6-6d45-4745-9c4b-79506a8658f7 req-c36eea3b-7f75-4efc-957c-06ccce5c1c37 service nova] Creating event network-changed:6ee11d09-9d61-424f-b809-00e67450dab4 for instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 on hv-cinder-80295 Jul 12 22:07:23.955685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-80cd9df6-6d45-4745-9c4b-79506a8658f7 req-c36eea3b-7f75-4efc-957c-06ccce5c1c37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086208 Jul 12 22:07:23.956959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 90/168] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:23.971011 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:23.972041 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:23.980634 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.982549 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:23.983785 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:23.985180 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:24.113706 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:24.143980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c578407-f9dd-47fa-874c-734d2ed5a4ef tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.319294 Jul 12 22:07:24.144571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 79/169] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:23 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:24.196250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:24.197618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:24.205871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:24.212067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:24.213505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:24.214668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:24.267692 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:24.278200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8e039b25-2f19-4483-8b44-c03f7506143a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.312304 Jul 12 22:07:24.281368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 91/170] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:23 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:24.489856 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:24.500045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e98adc0e-65a5-4cfa-8245-ab884f247dcc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.321706 Jul 12 22:07:24.500628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 80/171] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:24 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:24.631710 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-c7b96120-4967-41c9-adc4-daa4b464a3bb req-a02d7311-1b1a-4a80-80ba-61cb6242beb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f13d7c-c02d-4b72-90d6-8f7703ffd21c", "name": "network-vif-plugged", "status": "completed", "tag": "24b248d6-9626-4883-9d64-eb804e2a6c97"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:24.645117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c7b96120-4967-41c9-adc4-daa4b464a3bb req-a02d7311-1b1a-4a80-80ba-61cb6242beb5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:24.645812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c7b96120-4967-41c9-adc4-daa4b464a3bb req-a02d7311-1b1a-4a80-80ba-61cb6242beb5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:24.661566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-c7b96120-4967-41c9-adc4-daa4b464a3bb req-a02d7311-1b1a-4a80-80ba-61cb6242beb5 service nova] Creating event network-vif-plugged:24b248d6-9626-4883-9d64-eb804e2a6c97 for instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c on hv-cinder-80295 Jul 12 22:07:24.669971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-c7b96120-4967-41c9-adc4-daa4b464a3bb req-a02d7311-1b1a-4a80-80ba-61cb6242beb5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049226 Jul 12 22:07:24.671204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 92/172] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:07:25.162334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:25.164668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:25.171470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.172079 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.173109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.173947 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.298579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:25.299296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:25.307440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.308126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.309147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.309660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.341024 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:25.349852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f65847c2-d57d-4874-82a7-8b125ad19814 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.191917 Jul 12 22:07:25.351080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 81/173] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:25 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:25.462959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:25.470831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c68b73cf-80ec-42e8-9e00-350d6aa28d76 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.176738 Jul 12 22:07:25.471565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 93/174] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:25 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:25.517603 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:25.518217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:25.525774 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.526230 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.527025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:25.527474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:25.660403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:25.668337 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-07599f9c-cc8c-4878-a100-5ca32d20ff68 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.154735 Jul 12 22:07:25.668937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 82/175] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:25 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:26.370107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:26.370664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:26.377687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.378217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:26.379119 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.379680 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:26.491954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:26.492643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:26.500916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.503452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:26.504459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.511773 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:26.747963 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:26.755831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-385121ef-9a47-47dd-8fab-610524e410c4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.391301 Jul 12 22:07:26.757572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 94/176] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:26 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:26.762387 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:26.763247 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:26.770160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.770819 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:26.772878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:26.773514 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:27.038059 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:27.047355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f8a7a111-1979-4e7a-a115-b1b78e32ab65 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.288545 Jul 12 22:07:27.048003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 95/177] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:26 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:27.060470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-6e384ef3-23a0-4bb6-b325-f1e8e83685e3 req-9d8c99c8-ad03-4ec9-99c7-0b863502348b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca7f2f6-f0de-44d2-9f95-a04ba894bc66", "name": "network-vif-plugged", "status": "completed", "tag": "91661900-db83-420e-9017-4dd79576f7e7"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:27.069301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6e384ef3-23a0-4bb6-b325-f1e8e83685e3 req-9d8c99c8-ad03-4ec9-99c7-0b863502348b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:27.070254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6e384ef3-23a0-4bb6-b325-f1e8e83685e3 req-9d8c99c8-ad03-4ec9-99c7-0b863502348b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:27.077374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:27.083357 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-6e384ef3-23a0-4bb6-b325-f1e8e83685e3 req-9d8c99c8-ad03-4ec9-99c7-0b863502348b service nova] Creating event network-vif-plugged:91661900-db83-420e-9017-4dd79576f7e7 for instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 on hv-cinder-80295 Jul 12 22:07:27.088792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-6e384ef3-23a0-4bb6-b325-f1e8e83685e3 req-9d8c99c8-ad03-4ec9-99c7-0b863502348b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039667 Jul 12 22:07:27.089968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 96/178] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:27.095145 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8af8de0-6ee7-4fd0-af2d-93d391634e03 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.610204 Jul 12 22:07:27.105963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 83/179] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:26 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:27.775661 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:27.777178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:27.788142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:27.789592 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:27.789924 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:27.790970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:27.932672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:27.940698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-478d765e-bf72-4486-a785-bdf5377cfbcc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.170458 Jul 12 22:07:27.941264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 97/180] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:27 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:28.064086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:28.064815 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:28.071967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.072486 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:28.073352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.073867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:28.130240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:28.134483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:28.155998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:28.158787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.165798 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:28.170370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.172169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:28.308033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:28.316543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0a0cd6ee-8c0f-4b4d-95d4-5dd945faf32b tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.256221 Jul 12 22:07:28.317158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 84/181] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:28 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:28.386515 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:28.398451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fef6842a-5ea8-4c46-a0d2-73d35b69de8e tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.287208 Jul 12 22:07:28.399438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 98/182] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:28 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:28.960865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:28.962680 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:28.973694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.977181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:28.978022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:28.978474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:29.169359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:29.177964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe9b54f5-84aa-4ece-8fec-e4bf2f44365c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1322 microversion: 2.1 time: 0.223098 Jul 12 22:07:29.178740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 85/183] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:28 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:29.335101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:29.335814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:29.345990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:29.346896 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:29.347869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:29.348466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:29.421578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:29.423157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:29.436005 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:29.438750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:29.442082 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:29.442469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:29.685937 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:29.695596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:29.697780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f1d4343c-34a6-48f5-8eea-783c2c353617 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.366180 Jul 12 22:07:29.698885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 99/184] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:29 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:29.708774 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1b9100f2-72e3-4521-8ed1-926a514a37bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.288659 Jul 12 22:07:29.708774 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 86/185] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:29 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:30.195948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:30.196565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:30.203606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.204087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.204860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.205309 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.223787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=100 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.311127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.332065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.361196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:30.371534 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9d11250d-3e3d-4492-af9e-e6a2799602de tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1516 microversion: 2.1 time: 0.180408 Jul 12 22:07:30.372455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 100/186] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:30 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:30.389377 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:30.390392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:30.392229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.399581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.400058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.401110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.401362 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.425381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lazy-loading 'flavor' on Instance uuid 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:07:30.496105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.547653 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eba2b271-2c05-40ab-b313-aad12cc0dff5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66/action" status: 200 len: 32 microversion: 2.1 time: 0.162052 Jul 12 22:07:30.548511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 87/187] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:07:30 2022] POST /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:07:30.560993 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:30.561567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:30.567894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.568500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.570071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.570563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.713504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=10 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:30.719416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:30.720452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:30.729427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.730423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.731508 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.732207 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.745608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:30.753798 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1aa27cf7-7d6e-47e3-a2b6-e77d4b5d38f7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.199692 Jul 12 22:07:30.754830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 101/188] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:30 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:30.760584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:30.768078 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:30.781662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.782307 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.783236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:30.783869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:30.943079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:30.952858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c5f8a4a1-e2e8-421a-bbd2-f859f448d205 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.196918 Jul 12 22:07:30.953451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 102/189] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:30 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:31.002151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:31.011214 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8816badc-b98e-4c33-bfb9-5e4ff8e2abd1 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.298535 Jul 12 22:07:31.011798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 88/190] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:30 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:31.125753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-c8fcdca6-6b42-46ec-9931-26c16e92fe35 req-bc4b2d4e-8b2f-4a1f-8c33-9cc90b324249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7e86a8-1d55-4bb8-a02c-344f8e974058", "name": "network-vif-plugged", "status": "completed", "tag": "6ee11d09-9d61-424f-b809-00e67450dab4"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:31.136472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c8fcdca6-6b42-46ec-9931-26c16e92fe35 req-bc4b2d4e-8b2f-4a1f-8c33-9cc90b324249 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.137358 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c8fcdca6-6b42-46ec-9931-26c16e92fe35 req-bc4b2d4e-8b2f-4a1f-8c33-9cc90b324249 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.150602 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-c8fcdca6-6b42-46ec-9931-26c16e92fe35 req-bc4b2d4e-8b2f-4a1f-8c33-9cc90b324249 service nova] Creating event network-vif-plugged:6ee11d09-9d61-424f-b809-00e67450dab4 for instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 on hv-cinder-80295 Jul 12 22:07:31.156155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-c8fcdca6-6b42-46ec-9931-26c16e92fe35 req-bc4b2d4e-8b2f-4a1f-8c33-9cc90b324249 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Jul 12 22:07:31.157026 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 103/191] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:31.774937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:31.775542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:31.782358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.782876 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.783786 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.784452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:31.784936 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.785065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:31.792890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.793618 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.794545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.795258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.829464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-10f9fc36-e1be-402f-886e-e46db243a291 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/ips" status: 200 len: 148 microversion: 2.1 time: 0.049569 Jul 12 22:07:31.831017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 104/192] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:07:31 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:07:31.953232 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:31.963381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-997dae33-08f3-4f5e-945e-1372ef77a8c8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.192731 Jul 12 22:07:31.966760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 89/193] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:31 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:31.981581 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:31.982191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:31.989284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.989736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:31.991660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:31.992243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:32.028865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:32.029740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:32.038769 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:32.039609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:32.040790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:32.041347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:32.167935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:32.189160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aebcd0b2-04e9-4233-a71f-1c94db2edc18 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1317 microversion: 2.1 time: 0.221090 Jul 12 22:07:32.191101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 105/194] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:31 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:32.232121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:32.251493 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c8ff3f2b-7298-491f-8dd3-fec61898bb08 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.227233 Jul 12 22:07:32.252497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 90/195] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:32 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:32.988393 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:32.989154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:32.995871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:32.996256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:32.997074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:32.997514 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.157194 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:33.165047 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-822aabea-ae24-40f1-af63-0a98a6ba2cd8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.181102 Jul 12 22:07:33.165629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 106/196] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:32 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:33.187870 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e0cb6bf7-3c22-4ec3-b7f5-470f6c105023 req-d59025ab-4c4f-4350-8677-46b312462b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5765237-b68a-4285-895c-fb868aba4c8b", "name": "network-vif-plugged", "status": "completed", "tag": "e51faae8-807d-4876-9c92-2f59ecea3378"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:33.196926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e0cb6bf7-3c22-4ec3-b7f5-470f6c105023 req-d59025ab-4c4f-4350-8677-46b312462b1a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.197368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e0cb6bf7-3c22-4ec3-b7f5-470f6c105023 req-d59025ab-4c4f-4350-8677-46b312462b1a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.209628 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:33.210180 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:33.211404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e0cb6bf7-3c22-4ec3-b7f5-470f6c105023 req-d59025ab-4c4f-4350-8677-46b312462b1a service nova] Creating event network-vif-plugged:e51faae8-807d-4876-9c92-2f59ecea3378 for instance a5765237-b68a-4285-895c-fb868aba4c8b on hv-cinder-80295 Jul 12 22:07:33.216945 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.217476 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.217747 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e0cb6bf7-3c22-4ec3-b7f5-470f6c105023 req-d59025ab-4c4f-4350-8677-46b312462b1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033269 Jul 12 22:07:33.218257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.218676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 91/197] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:33.222018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.277355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:33.278058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:33.285359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.286085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.287295 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.292581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.431312 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:33.449809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-84594301-bdb6-48dc-8eef-769fb595d581 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1506 microversion: 2.1 time: 0.237697 Jul 12 22:07:33.451098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 107/198] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:33 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:33.456752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:33.458243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:33.466355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:33.474091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8b37db7f-93dc-451c-a4c1-2df5d28a3b38 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.202935 Jul 12 22:07:33.483537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 92/199] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:33 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:33.488252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.489858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:33.494875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:33.495439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.183839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:34.184396 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:34.190860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.191426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.192045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.192541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.353981 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:34.365562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66f63ffd-17a7-4a72-9183-da374fc0ffb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.185321 Jul 12 22:07:34.369705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 93/200] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:34 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:34.421419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aa4498e3-49ca-4be0-aa35-249f2fd4696a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968575 Jul 12 22:07:34.422216 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 108/201] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:07:33 2022] POST /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:34.496452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:34.497251 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:34.506353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.507135 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.509058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.509651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.655867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:34.664436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eeceb516-e8be-4b82-9619-fed3730c2c56 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1313 microversion: 2.1 time: 0.173420 Jul 12 22:07:34.665334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 94/202] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:34 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:34.670812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:34.671447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:34.678837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.679275 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.680038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:34.680466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:34.705447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f4c1f426-adc5-4302-8081-aa75c1f69206 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/ips" status: 200 len: 151 microversion: 2.20 time: 0.039289 Jul 12 22:07:34.705938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 109/203] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jul 12 22:07:34 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:07:35.386445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:35.387053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:35.393138 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:35.393591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:35.394358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:35.394795 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:35.541521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:35.549914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-97ba1be7-7657-4774-9d93-1157cd7abcc7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.167245 Jul 12 22:07:35.550518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 95/204] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:35 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:35.683800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:35.684502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:35.691133 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:35.691575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:35.692334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:35.692787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:35.854520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:35.862521 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7183d965-76f2-401d-9cab-d2b1c11c1ecc tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1496 microversion: 2.1 time: 0.182678 Jul 12 22:07:35.863338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 110/205] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:35 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1496 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:36.415116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:36.415633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:36.422274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.422733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.423497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.423956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.451466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:07:36.533172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-192c72bd-f761-4d63-9a77-787b29761566 tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 204 len: 0 microversion: 2.1 time: 0.121930 Jul 12 22:07:36.533769 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 96/206] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:07:36 2022] DELETE /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:07:36.543007 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:36.543574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:36.550222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.550660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.551531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.552098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.568394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:36.569186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:36.575458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.575841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.576650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.577192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.703617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:36.712883 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-755f3bd5-c9b3-40a6-bb3a-54257efccf1d tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1502 microversion: 2.1 time: 0.173555 Jul 12 22:07:36.713404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 111/207] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:36 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:36.718292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:36.718830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:36.723831 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:36.726731 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.727332 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.728152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:36.728754 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:36.736402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96da0373-8aae-4126-bd91-41f4b2b77ca4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.172028 Jul 12 22:07:36.737012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 97/208] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:36 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:36.753839 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lazy-loading 'flavor' on Instance uuid a50872f4-2ebb-4811-852b-3413585e6e7b {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:07:37.063467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8cf57e4c-95e8-4880-85cc-58fd31f85491 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/action" status: 202 len: 0 microversion: 2.20 time: 0.348829 Jul 12 22:07:37.064230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 112/209] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jul 12 22:07:36 2022] POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:07:37.073301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:37.073908 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:37.080605 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.081100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.081919 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.082325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.239386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:37.247950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:37.249497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:37.250648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1b7c77e-460a-44f4-90ed-0ea4afedaee3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.181766 Jul 12 22:07:37.251216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 98/210] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:37 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:37.735008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:37.735894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:37.742867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.743318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.744105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.744543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.755654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:37.756924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:37.765247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.765468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.766330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:37.766811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:37.893243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:37.901484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5a8d32ac-dc1a-4c27-abeb-bdd537df875e tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1502 microversion: 2.1 time: 0.171805 Jul 12 22:07:37.902126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 113/211] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:37 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:37.923822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:37.932385 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a59667ed-32b8-4fba-9131-fa776c376d65 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.180757 Jul 12 22:07:37.933014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 99/212] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:37 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:38.271116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:38.272073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:38.278531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.278979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.279757 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.280191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.507255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:38.518899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:38.520482 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:38.529815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-30d75580-e432-4ad7-ade0-3de70005b07f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.262573 Jul 12 22:07:38.530453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 114/213] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:38 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:38.735870 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7ab72049-7748-4a38-9480-24113341d221 req-9ca14c10-0c06-440c-a43a-97f9c1578613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5765237-b68a-4285-895c-fb868aba4c8b", "name": "network-vif-deleted", "tag": "e51faae8-807d-4876-9c92-2f59ecea3378"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:38.745012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7ab72049-7748-4a38-9480-24113341d221 req-9ca14c10-0c06-440c-a43a-97f9c1578613 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.746238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7ab72049-7748-4a38-9480-24113341d221 req-9ca14c10-0c06-440c-a43a-97f9c1578613 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.759127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7ab72049-7748-4a38-9480-24113341d221 req-9ca14c10-0c06-440c-a43a-97f9c1578613 service nova] Creating event network-vif-deleted:e51faae8-807d-4876-9c92-2f59ecea3378 for instance a5765237-b68a-4285-895c-fb868aba4c8b on hv-cinder-80295 Jul 12 22:07:38.764740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7ab72049-7748-4a38-9480-24113341d221 req-9ca14c10-0c06-440c-a43a-97f9c1578613 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 Jul 12 22:07:38.765480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 100/214] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:38.922414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:38.923190 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:38.930677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.931131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.931900 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.932335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.936470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:38.951744 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:38.952459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:38.959695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.960249 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:38.961153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:38.961674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:39.120298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:39.120505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:39.120850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:39.121407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lazy-loading 'fault' on Instance uuid a5765237-b68a-4285-895c-fb868aba4c8b {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:07:39.129097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-16591c1d-eb5a-4e80-b0a1-a154aa2b9a7b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.181793 Jul 12 22:07:39.129672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 101/215] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:38 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:39.168321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f97c33dcc74dd4ad69c277415f4643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ae4bdbbf74ec9896a31d1f72ed72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:39.176035 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0c4332ea-ab93-45eb-b4a1-f09e6e85c1db tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 200 len: 1303 microversion: 2.1 time: 0.258064 Jul 12 22:07:39.176528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 115/216] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:38 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 1303 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:39.549582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:39.550186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:39.556476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:39.557037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:39.557803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:39.558240 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:39.692413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:39.701802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:39.703313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:39.704468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e58ecc20-74ad-41a4-bd9f-3a0300d346e6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.158826 Jul 12 22:07:39.705092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 102/217] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:39 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:40.146808 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:40.147424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:40.154222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.154675 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:40.155455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.155892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:40.192228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:40.193007 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] [instance: a5765237-b68a-4285-895c-fb868aba4c8b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:40.199770 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.200223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:40.201018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.201448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:40.205691 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:40.220560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] HTTP exception thrown: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Request method failure captured: Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b HTTP/1.1 Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfB7_x_9SJIDtquKy2F1oHdWDN7bQbwWfppOwQFbnD65ZjvrJtpUxQUpi3WnrMnQspXdfQRPMVK5jmOnQH5jM8vpPVgoxD_JUMSrRpcCTeAN3nnKRH-8Q6LXSEBN_1GmC6O2UUSwbd1LiJTmBGO-Ep8hEWYbX-0-iDn8KDYLrQpTX2U Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 304ae4bdbbf74ec9896a31d1f72ed72a Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesActionsTest-690534395 Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:07:40.222256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/304ae4bdbbf74ec9896a31d1f72ed72a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesActionsTest-690534395 Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 304ae4bdbbf74ec9896a31d1f72ed72a Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesActionsTest-690534395 Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesActionsTest-690534395-project Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 64f97c33dcc74dd4ad69c277415f4643 Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesActionsTest-690534395-project Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. Jul 12 22:07:40.223749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'a5765237-b68a-4285-895c-fb868aba4c8b'} Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:07:40.224580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. Jul 12 22:07:40.225911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:07:40.229494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] Returning 404 to user: Instance a5765237-b68a-4285-895c-fb868aba4c8b could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:07:40.229494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0b6fbb5f-86f8-4637-ace3-7a3024c3197a tempest-VolumesActionsTest-690534395 tempest-VolumesActionsTest-690534395-project] 10.222.0.44 "GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b" status: 404 len: 111 microversion: 2.1 time: 0.035350 Jul 12 22:07:40.234165 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 103/218] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:40 2022] GET /compute/v2.1/servers/a5765237-b68a-4285-895c-fb868aba4c8b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:07:40.345546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:40.364047 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eaef8a3a-bd70-4804-a10c-0ca521b7d53d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.220647 Jul 12 22:07:40.374899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 116/219] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:40 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:40.724386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:40.725082 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:40.736527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.737067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:40.737841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:40.738276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:41.019508 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:41.029378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:41.031184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:41.033120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ebbbb2af-5dfb-443b-8e11-f3dba4ae10c3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.313015 Jul 12 22:07:41.037802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 104/220] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:40 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:41.382504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:41.383314 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:41.389976 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:41.390673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:41.391443 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:41.392117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:41.801310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:41.809224 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-cea03841-06be-4945-bf5a-613b7b1db8c3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.431276 Jul 12 22:07:41.809797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 117/221] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:41 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:42.053258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:42.054183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:42.061485 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:42.062039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:42.063055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:42.063794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:42.218818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:42.228792 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:42.230799 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:42.232347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c1a752ea-2bff-4d6c-b8f5-33e59643cb1f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.184181 Jul 12 22:07:42.233103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 105/222] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:42 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:42.827711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:42.828473 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:42.835556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:42.836001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:42.836814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:42.837418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:42.986823 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:42.995278 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-44070166-2d7f-4b4a-b162-a5764281060a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.171473 Jul 12 22:07:42.995894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 118/223] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:42 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:43.254589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:43.256250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:43.265188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:43.265906 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:43.266684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:43.267115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:43.432448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:43.441036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:43.442527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:43.444252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-57aadb35-07e3-44b9-bee0-397a390b60cd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.195607 Jul 12 22:07:43.445091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 106/224] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:43 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:44.013579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:44.014429 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:44.021779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:44.022484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:44.023325 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:44.023848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:44.167329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:44.186080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d1928e93-3f90-48c8-b520-4bb79e980482 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.176555 Jul 12 22:07:44.186718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 119/225] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:44 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:44.465383 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:44.466214 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:44.472286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:44.472768 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:44.473583 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:44.474013 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:44.611769 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:44.620805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:44.622577 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:44.623808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a99930da-ec74-4f6e-9e77-7a577cb88616 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.162851 Jul 12 22:07:44.624410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 107/226] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:44 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:45.206160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:45.206780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:45.213999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:45.214624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:45.215243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:45.215687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:45.320648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5f50968a-d785-4a1a-a5af-d7ff063ce07d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: .version_select at 0x7f1b6bf06a60>, body: {"keypair": {"name": "tempest-keypair-1832925666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6NhNkMKIDOsnLOI0W1jm7d3gHwNfY7FR5GByulw/hNdBWSy6b6jjxuzYPAG0LKutNwIJYWetjU+T8y5c0JbsCSF13gzzuvUAKYPOzPB4cbK/1N3kgQITZrSLyvt9Bpkw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:45.335619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5f50968a-d785-4a1a-a5af-d7ff063ce07d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:07:45.337913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:45.340880 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-5f50968a-d785-4a1a-a5af-d7ff063ce07d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:07:45.368475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5f50968a-d785-4a1a-a5af-d7ff063ce07d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052722 Jul 12 22:07:45.375324 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 108/227] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:07:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:07:45.455450 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:45.464741 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-cddf9fdc-61f7-4130-8a6a-56c5f5cd77bb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.262330 Jul 12 22:07:45.469085 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 120/228] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:45 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:45.644512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:45.649368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:45.655909 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:45.656760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:45.657540 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:45.657969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:45.825978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:45.836455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:45.838184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:45.839471 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f8e86436-9ced-4356-b44f-30365a86c066 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.200276 Jul 12 22:07:45.840060 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 109/229] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:45 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:46.483767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:46.484384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:46.496855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:46.497303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:46.498084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:46.498613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:46.743128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:46.751083 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e90172a4-f2e1-4d95-8c2b-0584a77b0de6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.271158 Jul 12 22:07:46.751785 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 121/230] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:46 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:46.859875 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:46.860499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:46.879442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:46.879954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:46.883002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:46.883654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:47.040630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:47.049172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:47.050728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:47.052020 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ade9946-c23e-4816-9135-d5e548ace8fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.196454 Jul 12 22:07:47.052760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 110/231] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:46 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:47.135910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2124496416", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afbe5681-6e61-4873-a265-db662a1dd309"}], "security_groups": [{"name": "tempest-securitygroup--144943410"}], "key_name": "tempest-keypair-1832925666", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:47.769408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:47.770138 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:47.777136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:47.777676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:47.778552 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:47.779080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:47.957628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:47.966572 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ecbd084-d3e3-41ab-9e11-2cbc7e600056 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.201088 Jul 12 22:07:47.967305 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 111/232] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:47 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:48.070919 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:48.071523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:48.077922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:48.078353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:48.079120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:48.079549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:48.240624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:48.257178 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:48.259424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:48.262019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6f3598c1-dafe-447c-bdcd-ef075bc8f96e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.196132 Jul 12 22:07:48.262626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 112/233] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:48 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:48.989975 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:48.991085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:49.002061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:49.002762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:49.003880 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:49.004531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:49.187973 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:49.198321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c2ab677-839c-44b5-9652-4cf7df48aa55 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.215904 Jul 12 22:07:49.199067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 113/234] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:48 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:49.285044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:49.285909 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:49.293687 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:49.294374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:49.295462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:49.296061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:49.532141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:49.542175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:49.545202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:49.546376 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6bd10bcb-ddac-4049-8360-3fbcc73eb847 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.265880 Jul 12 22:07:49.547107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 114/235] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:49 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:50.218411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:50.219243 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:50.225942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:50.226522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:50.227285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:50.227626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:50.394164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:50.402564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3cf52550-46c4-4009-a1d5-4651cd5b4b84 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.188048 Jul 12 22:07:50.403343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 115/236] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:50 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:50.566351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:50.567273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:50.574490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:50.574945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:50.575720 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:50.576157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:50.757820 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:50.767202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:50.769589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:50.772046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e6e80fd-ff4b-48fd-bebb-5a22a3779186 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.209486 Jul 12 22:07:50.772927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 116/237] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:50 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:51.419929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:51.420630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:51.437939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:51.438581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:51.439576 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:51.439812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:51.619289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:51.627194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fa56e366-2567-468f-b56f-9d8dab685463 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.211104 Jul 12 22:07:51.627772 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 117/238] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:51 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:51.798123 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:51.798937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:51.807351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:51.808034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:51.809171 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:51.809826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:52.002481 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:52.013426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:52.015089 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:52.016350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-31108445-a5d7-415c-883d-63bfaf488893 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.226360 Jul 12 22:07:52.017113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 118/239] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:51 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:52.647513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:52.649113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:52.655545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:52.655867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:52.656632 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:52.657091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:52.850174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:52.857811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3dba83da-7c57-4104-bb56-b0b4f660c968 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.214973 Jul 12 22:07:52.858544 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 119/240] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:52 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:53.040153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:53.040800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:53.046932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:53.047409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:53.048180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:53.048618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:53.199629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:53.210125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:53.210453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:53.212101 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d8e0529-7bec-4489-95e9-5ef1dec8c487 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.177184 Jul 12 22:07:53.214210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 120/241] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:53 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:53.876657 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:53.877422 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:53.884911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:53.885431 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:53.886794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:53.887426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:53.909960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:54.053866 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:54.063991 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b02abc6-9d95-413b-b38d-519f90d9ef54 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.191234 Jul 12 22:07:54.064766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 121/242] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:53 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:54.233324 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:54.234024 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:54.241658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:54.242238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:54.243243 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:54.243949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:54.394822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:54.405014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:54.407132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:54.408501 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c76212ac-add2-4b4b-8696-b2c070f85387 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1744 microversion: 2.20 time: 0.179005 Jul 12 22:07:54.409977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 122/243] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:54 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:55.083199 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:55.084089 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:55.090699 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:55.091237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:55.092326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:55.092690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:55.261942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:55.269710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-459cabc5-99a7-4de3-bcf2-33bbc0168a57 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.190376 Jul 12 22:07:55.279755 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 123/244] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:55 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:55.433680 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:55.434800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:55.438007 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:55.448949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:55.449980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:55.451692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:55.452670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:55.602701 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:55.611469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:55.612996 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:55.614178 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fc6ea6e5-22c5-46c3-add6-4870e3177bde tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1744 microversion: 2.20 time: 0.188071 Jul 12 22:07:55.615315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 124/245] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:55 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:56.287288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:56.288023 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:56.294446 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:56.294953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:56.295725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:56.296185 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:56.465149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:56.481300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c0817a7a-4ee4-4dfb-9084-dccab60bc185 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.197991 Jul 12 22:07:56.483044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 125/246] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:56 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:07:56.636047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:56.636663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:56.643300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:56.643736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:56.644499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:56.645117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:56.748230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=42 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:56.806241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:56.817705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:56.821319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:56.822540 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a276367b-1a02-472c-a72c-cab1592e20bf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1744 microversion: 2.20 time: 0.190649 Jul 12 22:07:56.823116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 126/247] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:56 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:57.144380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=51 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:07:57.499117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:57.499886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:57.507658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:57.508469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:57.509494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:57.510083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:57.679489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:57.688587 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c65819d-077b-4374-9e14-efed7da0406d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.193380 Jul 12 22:07:57.689566 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 127/248] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:57 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:57.844921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:57.845529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:57.852090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:57.852561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:57.853371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:57.853903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:58.066252 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:58.077219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:58.079107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:58.080463 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2e531fed-78c0-4b05-85c0-27f2adf6e093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.239589 Jul 12 22:07:58.104918 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 128/249] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:57 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:07:58.617331 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-61066375-ec50-488f-a413-18dfc2a50f26 req-fc3febbf-514f-45a5-aa32-55dd8c89813c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "name": "network-vif-plugged", "status": "completed", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:07:58.629059 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-61066375-ec50-488f-a413-18dfc2a50f26 req-fc3febbf-514f-45a5-aa32-55dd8c89813c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:58.631175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-61066375-ec50-488f-a413-18dfc2a50f26 req-fc3febbf-514f-45a5-aa32-55dd8c89813c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:58.648227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-61066375-ec50-488f-a413-18dfc2a50f26 req-fc3febbf-514f-45a5-aa32-55dd8c89813c service nova] Creating event network-vif-plugged:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:07:58.662740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-61066375-ec50-488f-a413-18dfc2a50f26 req-fc3febbf-514f-45a5-aa32-55dd8c89813c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049014 Jul 12 22:07:58.663585 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 129/250] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:07:58.718269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:58.719309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:58.728827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:58.729282 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:58.730288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:58.730739 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:58.886381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:58.896372 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41783bcb-9612-4c05-bed9-9c673bee0647 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.183072 Jul 12 22:07:58.897430 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 130/251] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:58 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:07:59.103319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:59.103956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:59.111206 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:59.111613 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:59.112609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:59.113110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:59.275211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:59.283458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:59.285030 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:07:59.286761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b93a885-ab5c-4e69-9437-eb53687e2fee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.189076 Jul 12 22:07:59.287544 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 131/252] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:07:59 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:07:59.914133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:07:59.914799 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:07:59.921180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:59.921630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:07:59.922391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:07:59.922915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:00.066273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:00.076357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf7eb96e-817c-471f-a682-5ecd72113333 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.166740 Jul 12 22:08:00.077374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 132/253] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:07:59 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:00.305173 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:00.305809 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:00.311926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:00.312368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:00.313162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:00.313596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:00.467160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:00.478589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:00.480157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:00.481395 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-10ecd4ee-8368-43e6-8f6d-0bfbe66075c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.180623 Jul 12 22:08:00.492246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 133/254] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:00 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:01.094453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:01.095114 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:01.113109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.115996 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.117010 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.117449 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.274372 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:01.276511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] validate_networks() for [('afbe5681-6e61-4873-a265-db662a1dd309', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:08:01.282488 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe93be6f-806c-407f-af6c-6272369645bf tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.191887 Jul 12 22:08:01.283063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 134/255] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:01 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:01.501331 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:01.501331 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:01.511358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.511358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.511358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.511358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.691931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:01.709132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:01.710766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:01.712436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9cee39a5-4437-424a-ad2e-76eb4d66687f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.216929 Jul 12 22:08:01.713621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 135/256] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:01 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:01.800488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:08:01.801226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:08:01.802640 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:08:01.803544 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:08:01.804147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:08:01.815689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.816439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.818432 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:01.819746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:01.853853 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:08:01.860605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:08:01.878792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:08:01.882759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:08:01.962316 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1c7b9780-711a-40ed-b294-fc1e1c5dc45b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 14.831615 Jul 12 22:08:01.963351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 122/257] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:07:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 14833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:08:01.979400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-65973ddc-3937-4240-ab86-c67af45660bd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:01.980509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-65973ddc-3937-4240-ab86-c67af45660bd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:02.080684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-65973ddc-3937-4240-ab86-c67af45660bd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:02.103052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-65973ddc-3937-4240-ab86-c67af45660bd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1242 microversion: 2.1 time: 0.132134 Jul 12 22:08:02.104315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 136/258] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:01 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:02.299862 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:02.311865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:02.381384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:02.381384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:02.381384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:02.381384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:02.737416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:02.738355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:02.746384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:02.747176 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:02.748227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:02.748932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:02.778488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:02.813191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9d90a0d6-0a96-49ae-ae97-d586d00f2006 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.517338 Jul 12 22:08:02.814064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 123/259] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:02 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:02.950201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:02.963821 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:02.977279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:02.979095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3d4095d7-66af-49c1-ac3c-3ff48849ad1e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.249819 Jul 12 22:08:02.980265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 137/260] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:02 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:03.120781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:03.121611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:03.130605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:03.131039 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:03.136084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:03.136533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:03.275059 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:03.291034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e3191568-3090-464e-a781-439b2f2036e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1238 microversion: 2.1 time: 0.173951 Jul 12 22:08:03.291639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 124/261] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:03 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1238 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:03.832363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:03.835610 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:03.855293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:03.856075 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:03.857200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:03.868640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:04.009319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:04.011033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:04.029474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:04.045835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:04.058763 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:04.059593 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:04.270814 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:04.284597 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-52266dab-5487-4b76-ac3d-83b358edff1c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.456264 Jul 12 22:08:04.297415 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 138/262] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:03 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:04.308834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:04.309658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:04.316688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:04.318162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:04.319676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:04.320275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:04.394668 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:04.417385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:04.423865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:04.433358 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a7f0578a-f7a2-4195-a1f1-42c42497d61b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.431084 Jul 12 22:08:04.436041 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 125/263] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:03 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:04.492588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:04.496358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:04.504153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2bd50a36-3948-45b5-8f06-317144996011 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1300 microversion: 2.1 time: 0.199609 Jul 12 22:08:04.515477 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 139/264] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:04 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:05.308497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:05.309961 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:05.321452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.322121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:05.323226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.323868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:05.455511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:05.456871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:05.476779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.477418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:05.478571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.478930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:05.799695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:05.816357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:05.823360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:05.832388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96694b12-4e78-4b3a-8cde-f5db9c738c76 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.381228 Jul 12 22:08:05.839846 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 140/265] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:05 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:05.845503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:05.847149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:05.847767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:05.858423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2912e7d1-3fc3-43b5-8e25-49a4fdb3ac36 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.554232 Jul 12 22:08:05.859161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 126/266] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:05 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:05.882688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.883211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:05.884340 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:05.886837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:06.091003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:06.100108 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-55d175e6-4a8b-4918-bb83-bc3178f3229a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.259088 Jul 12 22:08:06.110748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 141/267] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:05 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:06.586877 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-31356d9e-1cde-41c9-9308-5e5f13a7e9e9 req-b821a94c-ec16-474d-bb79-2fdbca7447b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654e05e7-6f82-4f9c-bc97-dbd95f40ea4d", "tag": "06eea394-1971-4677-a4ef-92e4c084a209"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:06.606195 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-31356d9e-1cde-41c9-9308-5e5f13a7e9e9 req-b821a94c-ec16-474d-bb79-2fdbca7447b2 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:06.606950 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-31356d9e-1cde-41c9-9308-5e5f13a7e9e9 req-b821a94c-ec16-474d-bb79-2fdbca7447b2 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:06.651674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-31356d9e-1cde-41c9-9308-5e5f13a7e9e9 req-b821a94c-ec16-474d-bb79-2fdbca7447b2 service nova] Creating event network-changed:06eea394-1971-4677-a4ef-92e4c084a209 for instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d on hv-cinder-80295 Jul 12 22:08:06.674637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-31356d9e-1cde-41c9-9308-5e5f13a7e9e9 req-b821a94c-ec16-474d-bb79-2fdbca7447b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095968 Jul 12 22:08:06.675639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 127/268] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:08:06.858011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:06.858913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:06.877965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:06.879425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:06.884352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:06.892584 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:06.894000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:06.894922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:06.897638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:06.901975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:06.906291 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:06.906966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:07.150189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:07.160010 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:07.162554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:07.163330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-19f52734-a6c8-4f29-ab64-4de2de831a82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.310246 Jul 12 22:08:07.164218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 142/269] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:06 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:07.169694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:07.170318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:07.180651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:07.181049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:07.181835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:07.182275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:07.362006 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:07.375619 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1d92011d-6327-42ce-b2ea-6ef3c45e7937 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.503380 Jul 12 22:08:07.376219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 128/270] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:06 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:07.393186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:07.402656 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e302d4d7-e076-450c-8341-134c0c2c1a96 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.237322 Jul 12 22:08:07.412358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 143/271] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:07 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:08.184510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:08.186032 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:08.200846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.202743 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.204497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.205815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.393286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:08.393905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:08.406994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.407681 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.408523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.409717 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.655683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:08.664689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-774b917f-e11e-4d6b-9b94-803b507d861a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.275318 Jul 12 22:08:08.665703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 144/272] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:08 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:08.671124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:08.672015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:08.679838 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.680300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.681371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:08.681931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:08.708966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:08.722154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:08.724749 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:08.731109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2bd8a45c-4017-4275-bb9b-609c90bb3bee tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.551122 Jul 12 22:08:08.732105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 129/273] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:08 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:09.035427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:09.061039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8bdbc9f7-6f28-451c-83b2-727fdc07abbf tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.393740 Jul 12 22:08:09.062417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 145/274] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:08 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:09.686756 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:09.688952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:09.700811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:09.701499 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:09.702558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:09.703248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:09.758083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:09.760014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:09.783915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:09.787266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:09.788983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:09.789685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:09.915137 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:09.930327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-57fed8f7-0168-4f6d-939c-e9ccd4cee468 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.251265 Jul 12 22:08:09.942688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 130/275] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:09 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:10.086785 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:10.088977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:10.093611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:10.104066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:10.106723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:10.107716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:10.109335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:10.110740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:10.111538 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:10.113151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0097253e-54d2-4770-ad22-153f85c1f0c0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.360444 Jul 12 22:08:10.117559 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 146/276] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:09 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:10.358027 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:10.368872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-62b4ebc9-3bcb-43fe-8822-8c10fb0b1d6e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.291413 Jul 12 22:08:10.370110 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 131/277] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:10 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:10.948046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:10.948684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:10.955646 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:10.956557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:10.969965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:10.970722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:11.138481 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:11.139433 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:11.157542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:11.158001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:11.158815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:11.159260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:11.284365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:11.298126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9166d553-cef9-46dd-b5ac-8f53d153f010 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.354129 Jul 12 22:08:11.298732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 147/278] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:10 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:11.387368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:11.387984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:11.398825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:11.399278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:11.400209 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:11.400654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:11.414243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:11.422378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:11.425380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:11.426985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8a518f0e-95c2-4814-91f0-770bb36f78ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.294898 Jul 12 22:08:11.428119 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 132/279] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:11 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:11.616074 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:11.630154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-78e17a18-366f-4b49-9aa9-0d6fcfb3dc1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.246433 Jul 12 22:08:11.631131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 148/280] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:11 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:12.315150 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:12.315761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:12.318637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:12.319829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:12.330571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.331363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.333311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.334064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.447671 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:12.448280 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:12.453801 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:12.458272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.459120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.460160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.460837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.498620 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:12.508787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3bd59506-a9d5-46ee-8bb5-be1514af7de2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.197353 Jul 12 22:08:12.509304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 133/281] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:12 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:12.648516 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:12.649468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:12.652658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:12.663807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:12.665537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:12.667052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd9abe9e-1ca1-4096-bf4c-df455a4a181a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.224701 Jul 12 22:08:12.667751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 149/282] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:12 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:12.672438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.672921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.673718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:12.674152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:12.913087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:12.922225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9359ad31-ac07-45d6-9f40-06cd07159349 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.278655 Jul 12 22:08:12.923265 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 134/283] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:12 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:13.527495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:13.528282 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:13.534880 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.535296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:13.536300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.536804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:13.690083 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:13.690854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:13.696750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:13.706866 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-93b075dd-33d1-45a9-a63c-69c377ab5754 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.182280 Jul 12 22:08:13.707218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.707908 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 150/284] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:13 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:13.709482 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:13.710296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.710743 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:13.860405 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:13.869207 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:13.870716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:13.871917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-422021e5-1584-4250-8f4f-0a49bfb6f3a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1739 microversion: 2.20 time: 0.189995 Jul 12 22:08:13.872436 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 135/285] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:13 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:13.943852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:13.945341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:13.953509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.954075 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:13.955015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:13.955582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:14.090190 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:14.097580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e215de69-1840-49db-9ba2-b51b3d27c9c1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.161439 Jul 12 22:08:14.098669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 151/286] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:13 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:14.724267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:14.725051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:14.731811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:14.732257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:14.733229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:14.733844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:14.891362 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:14.891999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:14.898724 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:14.899167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:14.900002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:14.900479 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:14.978555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:14.986578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-01fcf20c-4289-408c-b536-64063c75248d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.266950 Jul 12 22:08:14.999126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 136/287] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:14 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:15.050706 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:15.063284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:15.064828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:15.066119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-460c7b12-8332-4054-95a1-a621592dfe0a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1721 microversion: 2.20 time: 0.178523 Jul 12 22:08:15.067719 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 152/288] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:14 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:15.115252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:15.115867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:15.121998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:15.122447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:15.123237 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:15.123672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:15.346044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:15.353617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eae7dfff-f7fa-49cf-8d3c-65cbc4a1bc85 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.242443 Jul 12 22:08:15.354307 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 137/289] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:15 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:16.005434 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:16.006766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:16.013341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:16.015560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.016054 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.017160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.017413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.087001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:16.088325 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:16.094870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.095557 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.096367 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.096833 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.164675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:16.172619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd7bf7ab-f20b-426e-a805-7dbd5f4b9cf7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.171438 Jul 12 22:08:16.173482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 153/290] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:15 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:16.256926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:16.265261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:16.266851 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:16.268010 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-352c1a61-8c37-4b70-a10d-87955b0ed26f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1721 microversion: 2.20 time: 0.185940 Jul 12 22:08:16.268575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 138/291] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:16 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:16.370723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:16.371398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:16.382482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.383639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.384824 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:16.385469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:16.623915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:16.632011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0774b7bd-7e23-4771-8e15-06f8a54cd54d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.265192 Jul 12 22:08:16.633237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 154/292] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:16 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:17.189772 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:17.190532 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:17.197985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.198446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.199198 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.199625 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.288338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:17.289314 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:17.295819 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.296269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.297085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.297524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.334053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:17.338152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=100 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:17.344191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-061f139c-0f2d-44c5-8d9c-babd7ec7cc50 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.157988 Jul 12 22:08:17.345247 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 139/293] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:17 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:17.435335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:17.444096 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:17.445903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:17.447062 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ed6a77b-a596-4f28-a577-d2ded65e4279 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1721 microversion: 2.20 time: 0.163952 Jul 12 22:08:17.447619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 155/294] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:17 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:17.649382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:17.650005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:17.662901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.662901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.662901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.662901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.796378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:17.805322 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-25adb010-08bd-4a62-b272-0aa5d02dc01d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.160044 Jul 12 22:08:17.805891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 140/295] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:17 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:17.959235 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3e2b4b7-760e-41c8-862c-dfff0ba715e1", "device": "/dev/sdb"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:17.960978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:17.967153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.967592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.968351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:17.968964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:17.985531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:18.361562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:18.362177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:18.369165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.369613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.370411 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.370888 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.518747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:18.527567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a870deef-2cea-4d0f-81a1-6008efc80d98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.169712 Jul 12 22:08:18.528260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 141/296] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:18 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:18.532919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:18.533528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:18.540332 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.540821 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.541711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.542237 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.707590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:18.717942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:18.719493 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:18.720673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-16512aa4-53ae-4f25-8417-25cbca7da929 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1721 microversion: 2.20 time: 0.191429 Jul 12 22:08:18.721669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 142/297] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:18 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:18.764740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-09c772d9-a648-4b25-98a0-feae86cfe864 req-549825f3-8057-4abb-b0fb-51bbbba1b4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e05e7-6f82-4f9c-bc97-dbd95f40ea4d", "name": "network-vif-plugged", "status": "completed", "tag": "06eea394-1971-4677-a4ef-92e4c084a209"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:18.773510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-09c772d9-a648-4b25-98a0-feae86cfe864 req-549825f3-8057-4abb-b0fb-51bbbba1b4f1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.773968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-09c772d9-a648-4b25-98a0-feae86cfe864 req-549825f3-8057-4abb-b0fb-51bbbba1b4f1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.786553 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-09c772d9-a648-4b25-98a0-feae86cfe864 req-549825f3-8057-4abb-b0fb-51bbbba1b4f1 service nova] Creating event network-vif-plugged:06eea394-1971-4677-a4ef-92e4c084a209 for instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d on hv-cinder-80295 Jul 12 22:08:18.791944 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-09c772d9-a648-4b25-98a0-feae86cfe864 req-549825f3-8057-4abb-b0fb-51bbbba1b4f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030878 Jul 12 22:08:18.792553 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 143/298] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:08:18.824178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:18.824918 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:18.831165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.831618 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:18.832389 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:18.832881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.036502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:19.054111 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e9f8f741-df3a-4098-bbc4-f2915b92ee8a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.234437 Jul 12 22:08:19.054716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 144/299] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:18 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:19.144926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9462df5e-07e1-480d-b88f-0ab979cd6f79 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "POST /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.189431 Jul 12 22:08:19.145543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 156/300] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:08:17 2022] POST /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058/os-volume_attachments => generated 194 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:08:19.548321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:19.550269 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:19.558546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.559327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.561168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.561841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.747009 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:19.747528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:19.748788 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:19.764273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.764273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.764273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.764273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.764576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ee5e1d1c-8b75-4da2-9679-5891be105b8c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1522 microversion: 2.1 time: 0.221400 Jul 12 22:08:19.764576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 145/301] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:19 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:19.922258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:19.930568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:19.936622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:19.936622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-536f08be-bdb3-4de0-8ebd-11f20cc8ca87 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1664 microversion: 2.20 time: 0.198964 Jul 12 22:08:19.936622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 157/302] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:19 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:19.953554 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "550408f5-7b16-43b5-8d36-013f77a0bc2a"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:19.954714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:19.962447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.962898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:19.963685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:19.964128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.071770 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:20.072179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:20.079191 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.079639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.080643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.081263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.221515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:20.232749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-14904f5f-a10b-4bdc-847a-574ad9affa47 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.166118 Jul 12 22:08:20.263263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 158/303] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:20 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:20.284379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2422d251-92a7-4e16-a684-7ad32523fa0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335028 Jul 12 22:08:20.285451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 146/304] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jul 12 22:08:19 2022] POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:08:20.398258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:20.398830 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:20.405031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.405486 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.406248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.406685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.498312 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2063b907-2e9b-4bcd-b650-8774f721feed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/action" status: 202 len: 0 microversion: 2.20 time: 0.104176 Jul 12 22:08:20.498912 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 159/305] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jul 12 22:08:20 2022] POST /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:08:20.507376 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:20.508077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:20.516098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.517498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.518346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.519296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.659955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:20.669163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:20.670722 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:20.671879 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b8b25131-e918-486f-a554-d272196828fe tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1750 microversion: 2.20 time: 0.168803 Jul 12 22:08:20.672438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 147/306] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:20 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:20.781621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:20.782234 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:20.790337 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.790713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.791662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.791955 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.818213 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-b0115948-9137-45fe-b3b4-68eaf22b6d27 req-9633bd49-8540-4158-91df-e83ffe724dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "name": "network-vif-unplugged", "status": "completed", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:20.828600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-b0115948-9137-45fe-b3b4-68eaf22b6d27 req-9633bd49-8540-4158-91df-e83ffe724dd4 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.829064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-b0115948-9137-45fe-b3b4-68eaf22b6d27 req-9633bd49-8540-4158-91df-e83ffe724dd4 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.843950 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.compute.server_external_events [req-b0115948-9137-45fe-b3b4-68eaf22b6d27 req-9633bd49-8540-4158-91df-e83ffe724dd4 service nova] Unable to find a host for instance a50872f4-2ebb-4811-852b-3413585e6e7b. Dropping event network-vif-unplugged {{(pid=117937) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 22:08:20.845334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-b0115948-9137-45fe-b3b4-68eaf22b6d27 req-9633bd49-8540-4158-91df-e83ffe724dd4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031232 Jul 12 22:08:20.845973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 148/307] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 12 22:08:20.945169 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:20.954997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eae33400-5187-421c-b4be-c809ed4f74a1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1502 microversion: 2.1 time: 0.178022 Jul 12 22:08:20.955822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 160/308] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:20 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:20.974179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:20.974817 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:20.983228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.983683 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:20.984463 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:20.984938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:21.160453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:21.169360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-34e6e6d7-0fcb-4cce-bc94-18b1ffe8eb5d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1516 microversion: 2.1 time: 0.200032 Jul 12 22:08:21.172982 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 149/309] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:20 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:21.252161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:21.252686 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:21.261853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:21.262962 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:21.263855 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:21.264513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:21.435883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:21.445804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f65a6c8e-3e1d-4ca6-ba53-b711ab5810cd tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1367 microversion: 2.1 time: 0.197909 Jul 12 22:08:21.446379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 161/310] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:21 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:21.691109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:21.691741 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:21.698751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:21.699196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:21.699960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:21.700391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:21.850208 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:21.860152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:21.861697 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:21.862901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1b979cc1-3037-40f1-be58-b9f90cd8f1a3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1750 microversion: 2.20 time: 0.175843 Jul 12 22:08:21.863474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 150/311] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:21 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:22.462470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:22.463106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:22.469672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.470116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.470873 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.471308 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.605329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:22.626978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-78fe825d-7c01-40de-8831-110e72554cda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1556 microversion: 2.1 time: 0.167412 Jul 12 22:08:22.627636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 162/312] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:22 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:22.647208 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:22.648019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:22.656436 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.657057 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.657972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.658607 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.684223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:22.685318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:22.691669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.692478 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.693299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.693899 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.760464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-30bf2768-f3b6-40c1-a993-f6f36cfeabe2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120062 Jul 12 22:08:22.761107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 151/313] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:08:22 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:08:22.867802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lazy-loading 'flavor' on Instance uuid 64f13d7c-c02d-4b72-90d6-8f7703ffd21c {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:08:22.883206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:22.884195 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:22.890414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.891575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.892428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.893223 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.948066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e7cc6ad0-efff-4b27-ae0f-f1e730cee4be tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/action" status: 200 len: 32 microversion: 2.1 time: 0.267826 Jul 12 22:08:22.948742 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 163/314] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:08:22 2022] POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 22:08:22.960268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:22.960977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:22.980172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.980870 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:22.981817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:22.982258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:23.078611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:23.088668 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:23.094242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:23.095832 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7979bcfe-f3c3-4786-a1a2-bd8194b1b7a0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.217616 Jul 12 22:08:23.096398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 152/315] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:22 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:23.241427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:23.249110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-49fa8d57-3563-4f73-8f35-de45a336e3f4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.294283 Jul 12 22:08:23.249678 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 164/316] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:22 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:23.869727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-278142bc-e061-4cdf-862d-e494f94995b6 req-873b5e53-bd3d-431c-8376-2cdd4a4d6d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654e05e7-6f82-4f9c-bc97-dbd95f40ea4d", "tag": "06eea394-1971-4677-a4ef-92e4c084a209"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:23.878938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-278142bc-e061-4cdf-862d-e494f94995b6 req-873b5e53-bd3d-431c-8376-2cdd4a4d6d58 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:23.879382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-278142bc-e061-4cdf-862d-e494f94995b6 req-873b5e53-bd3d-431c-8376-2cdd4a4d6d58 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:23.891738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-278142bc-e061-4cdf-862d-e494f94995b6 req-873b5e53-bd3d-431c-8376-2cdd4a4d6d58 service nova] Creating event network-changed:06eea394-1971-4677-a4ef-92e4c084a209 for instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d on hv-cinder-80295 Jul 12 22:08:23.897753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-278142bc-e061-4cdf-862d-e494f94995b6 req-873b5e53-bd3d-431c-8376-2cdd4a4d6d58 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031596 Jul 12 22:08:23.898703 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 153/317] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:08:24.114650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:24.115256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:24.121833 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:24.122281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:24.123042 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:24.123475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:24.254094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:24.264032 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:24.265584 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:24.266761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd65d055-71c0-4e86-9ab9-f4022e821bea tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.156105 Jul 12 22:08:24.271900 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 165/318] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:24 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:24.272155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:24.272155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:24.277068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:24.277634 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:24.278537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:24.279090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:24.419174 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:24.427929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1e262b7d-b394-4a22-b000-4cefbc25eaa7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.164110 Jul 12 22:08:24.428527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 154/319] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:24 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:25.295294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:25.295905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:25.303168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:25.303611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:25.304365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:25.304840 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:25.437167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:25.446828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:25.448385 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:25.449573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a184278-bd86-4874-a666-eb32def545f3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.158171 Jul 12 22:08:25.450122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 166/320] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:25 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:25.453645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:25.454259 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:25.461893 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:25.462352 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:25.463157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:25.463621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:25.593864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:25.602660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-66427d97-f7a6-4722-b7bc-64a0d424c456 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.152819 Jul 12 22:08:25.603223 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 155/321] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:25 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:26.468276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:26.468910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:26.476160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:26.476605 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:26.477384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:26.477819 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:26.603909 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:26.612206 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:26.614296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:26.615455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4fd787a6-c2aa-4c0e-a829-706b30d6491b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.151045 Jul 12 22:08:26.616011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 167/322] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:26 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:26.620467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:26.621883 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:26.628013 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:26.628466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:26.630685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:26.631129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:26.638522 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:26.774061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:26.781713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4d615c8d-a553-4a41-abbe-dfc4dc2c60b5 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.165388 Jul 12 22:08:26.782275 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 156/323] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:26 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:27.636589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:27.637228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:27.643757 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:27.644207 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:27.645017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:27.645453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:27.799955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:27.800646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:27.804838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:27.809617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:27.810060 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:27.810837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:27.811267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:27.960862 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:27.969786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e17e6611-5dc7-45ec-bb93-dccb0f9a657e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.173996 Jul 12 22:08:27.970373 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 157/324] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:27 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:28.003162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:28.007246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:28.013431 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:28.014961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:28.016112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-810c3e97-dafb-41c3-8085-0f5a8c7db309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.383605 Jul 12 22:08:28.016669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 168/325] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:27 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:28.986830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:28.987461 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:28.994727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:28.995156 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:28.995921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:28.996353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:29.036092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:29.036740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:29.044534 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:29.045007 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:29.045791 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:29.046228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:29.129539 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:29.141294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e3bec1c7-a2ae-418f-bc49-602c43769f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.158183 Jul 12 22:08:29.141871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 158/326] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:28 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:29.179009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:29.187659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:29.189189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:29.190368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a352116a-9824-4c41-9f17-b3a83ef6a021 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.159774 Jul 12 22:08:29.190911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 169/327] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:29 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:30.159202 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:30.159817 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:30.167153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:30.167604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:30.168379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:30.168839 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:30.209158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:30.209762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:30.216380 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:30.216866 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:30.217641 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:30.218080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:30.303461 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:30.311002 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b160e827-5d96-48af-a230-a52bd592cb98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.155901 Jul 12 22:08:30.311576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 159/328] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:30 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:30.358700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:30.367887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:30.369428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:30.370663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fcccd96a-596b-4514-a833-5ffa18a789e5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.165652 Jul 12 22:08:30.371212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 170/329] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:30 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:31.327841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:31.328454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:31.335265 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:31.335719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:31.336488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:31.336958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:31.389195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:31.389807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:31.397812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:31.398486 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:31.398970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:31.399409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:31.473553 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:31.481217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-549f9467-f535-4f3d-8e9e-a1fbbdc64e51 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.157149 Jul 12 22:08:31.481792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 160/330] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:31 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:31.532468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:31.541976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:31.543433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:31.544594 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1a4e67a-3868-43f8-a6d7-d7fc594b11ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.159358 Jul 12 22:08:31.545183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 171/331] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:31 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:32.498670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:32.499284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:32.505864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:32.506314 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:32.507087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:32.507530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:32.563444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:32.564177 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:32.571161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:32.571549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:32.572330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:32.572793 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:32.637962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:32.645565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1f9fbaa3-a49d-4b79-8ada-43888310a55b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.150667 Jul 12 22:08:32.646147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 161/332] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:32 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:32.707213 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:32.716000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:32.717580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:32.718725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a410afea-22f9-4a52-8916-6f5b5debef8c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.159255 Jul 12 22:08:32.719327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 172/333] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:32 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:33.662979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:33.663503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:33.670296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:33.670741 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:33.671506 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:33.671943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:33.739436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:33.740061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:33.748561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:33.749046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:33.749839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:33.750282 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:33.815046 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:33.823841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1a030a1d-2ddc-43ed-ac42-fbf625b4cb4a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.164915 Jul 12 22:08:33.824419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 162/334] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:33 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:33.894161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:33.902604 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:33.904092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:33.905272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2f45572b-5441-4348-af46-ceba4686328f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.171048 Jul 12 22:08:33.905824 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 173/335] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:33 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:34.841583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:34.842383 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:34.850936 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:34.851601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:34.852227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:34.852737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:34.924622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:34.925440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:34.937343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:34.937906 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:34.938826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:34.939408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:35.002613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:35.010905 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0a7d9f29-7181-46a1-94b5-01235fc47726 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.173465 Jul 12 22:08:35.011548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 163/336] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:34 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:35.115505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:35.123802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:35.125384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:35.126524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ff1747c1-dd10-43be-a15b-460d68a1cb13 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1752 microversion: 2.20 time: 0.206806 Jul 12 22:08:35.127290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 174/337] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:34 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:36.028404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:36.029064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:36.036500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:36.036981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:36.037758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:36.038201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:36.147679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:36.148389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:36.155002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:36.155448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:36.156213 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:36.156643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:36.169170 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:36.176610 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-616c6830-2b6f-4a57-8545-e71f77336200 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.152019 Jul 12 22:08:36.177235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 164/338] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:36 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:36.292102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:36.300502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:36.302458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:36.303600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4b36ad72-81b2-45fa-a969-ba2f16ddd6ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.160472 Jul 12 22:08:36.304151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 175/339] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:36 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:37.193486 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:37.194033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:37.201098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:37.201552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:37.202328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:37.202770 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:37.322956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:37.323655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:37.330444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:37.330999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:37.331865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:37.332291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:37.339848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:37.347249 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2a3c045a-b199-4937-bbbe-49328a3c1a27 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.157677 Jul 12 22:08:37.347869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 165/340] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:37 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:37.500973 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:37.510562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:37.512065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:37.513287 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95d8ec09-665c-41e4-8152-bbdd35d175ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.194815 Jul 12 22:08:37.513860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 176/341] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:37 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:38.363984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:38.364595 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:38.371172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:38.371610 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:38.372364 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:38.372827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:38.513288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:38.521318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-57f367da-17ea-4d01-b461-3b13d4f06242 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.161816 Jul 12 22:08:38.521897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 166/342] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:38 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:38.537035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:38.537797 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:38.544484 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:38.544970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:38.545743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:38.546182 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:38.767666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:38.779254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:38.780778 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:38.782162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15191cb1-e53d-4e5d-8909-a34551fa9cc2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.254282 Jul 12 22:08:38.782714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 177/343] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:38 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:39.540075 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:39.540700 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:39.547414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:39.547855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:39.548615 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:39.549082 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:39.678418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:39.685891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-89195766-7377-4ced-be70-5ca21c8ce93e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.149729 Jul 12 22:08:39.686481 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 167/344] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:39 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:39.801286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:39.801899 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:39.808827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:39.809278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:39.810044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:39.810482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:39.943830 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:39.952408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:39.953938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:39.955084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cbea5c8b-bffc-44e0-b4f5-519d9111bf03 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.157743 Jul 12 22:08:39.955637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 178/345] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:39 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:40.703390 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:40.703912 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:40.710750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:40.711222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:40.711984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:40.712417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:40.849108 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:40.856546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2064a7ff-893f-4123-827c-7ac6a079c781 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.157134 Jul 12 22:08:40.857142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 168/346] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:40 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:40.974475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:40.975104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:40.981680 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:40.982122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:40.982874 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:40.983307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:41.120501 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:41.129266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:41.131400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:41.132588 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f1211cda-1ef1-4750-8c85-cb859c85a079 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.162530 Jul 12 22:08:41.133192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 179/347] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:40 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:41.874953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:41.875709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:41.884496 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:41.884994 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:41.885790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:41.886228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:42.040117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:42.048751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-03b99f48-8662-4b4f-ab1e-06e120e8f330 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.177433 Jul 12 22:08:42.059817 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 169/348] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:41 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:42.153384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:42.154761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:42.163631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:42.164097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:42.164975 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:42.165636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:42.359555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:42.371661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:42.374137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:42.375867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ffc11de-be7e-4d94-a6ed-6eeb5a362c4e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.226618 Jul 12 22:08:42.376884 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 180/349] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:42 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:43.073065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:43.073713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:43.091370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:43.101715 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:43.103462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:43.104088 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:43.322951 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:43.335822 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-24de61d3-f392-406d-aabb-b17f705a8646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.270942 Jul 12 22:08:43.337215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 170/350] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:43 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:43.397126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:43.398522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:43.406602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:43.407495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:43.408585 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:43.409398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:43.647033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:43.656994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:43.659499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:43.662636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7bea519e-6280-4474-b5ba-ab8257e3ef24 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.269730 Jul 12 22:08:43.663461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 181/351] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:43 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:44.360456 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:44.361286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:44.369415 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:44.369919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:44.370732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:44.371180 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:44.524557 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:44.534317 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0d623c89-ca72-48b3-9078-ec8a5c51486f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.176570 Jul 12 22:08:44.534317 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 171/352] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:44 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:44.681262 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:44.681839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:44.688269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:44.688729 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:44.689487 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:44.689914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:44.835324 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:44.844872 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:44.846748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:44.848231 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d7571f4-54d1-4127-9514-6119879a015a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.170936 Jul 12 22:08:44.859211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 182/353] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:44 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:45.550251 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:45.552157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:45.562483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:45.563118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:45.564153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:45.564586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:45.714270 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:45.718030 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=100 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:45.724644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d08ad925-90fb-489d-9824-7b6167fe9636 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.178750 Jul 12 22:08:45.725875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 172/354] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:45 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:45.867851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:45.868447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:45.876015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:45.876542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:45.877378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:45.877890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:46.029839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:46.038819 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:46.040319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:46.041503 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ad7446fc-da62-4725-9aa6-5e603b26b229 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.177554 Jul 12 22:08:46.042045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 183/355] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:45 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:46.742899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:46.743818 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:46.756536 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:46.757005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:46.758379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:46.759080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:46.919703 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:46.928153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-27af6730-179a-4d1f-adc4-1affd6220bbe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.189731 Jul 12 22:08:46.929271 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 173/356] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:46 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:47.063744 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:47.065463 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:47.070583 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=64 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:47.076364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:47.076909 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:47.077798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:47.078326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:47.318710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:47.334471 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:47.336144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:47.337372 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ad26e78b-f10c-4d9e-b84c-e6bca965da82 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.279253 Jul 12 22:08:47.338238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 184/357] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:47 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:47.716894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-675735914", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:08:47.801097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] validate_networks() for None {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:08:47.955218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:47.955218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:47.970474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:47.970672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:47.971336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:47.971864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:48.021375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:48.272359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:48.280451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f2943454-8ea4-437e-bf43-284c74e2ed14 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.330036 Jul 12 22:08:48.297528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 185/358] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:47 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:48.364757 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:48.365524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:48.377078 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:48.377492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:48.379122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:48.380006 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:48.593744 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:08:48.594288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:48.594570 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:08:48.596257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:08:48.597528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:08:48.598513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:08:48.604492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:48.614058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:48.618967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a5ace30-a499-4e47-9b81-d1af88a94d5b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.258551 Jul 12 22:08:48.619627 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 186/359] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:48 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:48.623122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:48.624168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:48.625672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:48.626816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:48.678887 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Getting quotas for project f86df0806e8747159530bd66cd36e7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:08:48.689424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Getting quotas for user dc1d7070c0db4eb4bba5e1e018da5bad and project f86df0806e8747159530bd66cd36e7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:08:48.723605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:08:48.726319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:08:48.805259 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-44033d5b-ef5f-4888-a39b-7b1193f44db9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092197 Jul 12 22:08:48.807054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 174/360] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:08:48.818600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db673e87-c032-4129-93c8-d2bbb58f8bd7 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:48.819543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db673e87-c032-4129-93c8-d2bbb58f8bd7 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:48.928369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-db673e87-c032-4129-93c8-d2bbb58f8bd7 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:48.938109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db673e87-c032-4129-93c8-d2bbb58f8bd7 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1214 microversion: 2.1 time: 0.125048 Jul 12 22:08:48.939873 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 187/361] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:48 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:49.308023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:49.309169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:49.320036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.321193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:49.322567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.323387 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:49.543977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:49.555303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2dd4c73f-cea8-457f-aae0-f0f0deafc0dc tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.251455 Jul 12 22:08:49.557373 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 175/362] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:49 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:49.639813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:49.640394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:49.648137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.648913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:49.649795 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.650229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:49.889355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:49.899742 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:49.901512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:49.902714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d2f9635a-c99d-4ab7-b3ea-5b825daf8093 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.267272 Jul 12 22:08:49.903355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 188/363] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:49 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:49.958740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:49.960184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:49.970734 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.971193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:49.982293 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:49.983535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.054203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:50.063716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6ad00302-28f5-4e68-9579-80161a6c63e3 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1218 microversion: 2.1 time: 0.109444 Jul 12 22:08:50.064424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 176/364] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:49 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:50.577375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:50.578299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:50.599712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.600083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.601090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.601615 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.759123 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:50.768018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d4848662-3932-4c5c-a442-97af9ad84a19 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.195743 Jul 12 22:08:50.768578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 189/365] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:50 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:50.900996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:50.901606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:50.910348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.911167 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.912248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.912870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.923851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:50.924765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:50.931836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.932683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:50.933664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:50.934254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:51.064014 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lazy-loading 'services' on Instance uuid 4e7e86a8-1d55-4bb8-a02c-344f8e974058 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:08:51.106607 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:51.128609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:51.130464 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:51.131710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b53af813-eb42-42f0-a2d5-3c46afb1676a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.211906 Jul 12 22:08:51.142112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 190/366] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:50 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:51.142112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:51.142112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:51.150933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:51.151386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:51.152164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:51.152603 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:51.233903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:51.234571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8ef77c1d-014a-4028-9a67-1c55f09addb8 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058/os-volume_attachments/f3e2b4b7-760e-41c8-862c-dfff0ba715e1" status: 202 len: 0 microversion: 2.1 time: 0.338178 Jul 12 22:08:51.239530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 177/367] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:08:50 2022] DELETE /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058/os-volume_attachments/f3e2b4b7-760e-41c8-862c-dfff0ba715e1 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:08:51.244135 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6de61ccd-3825-489e-95a0-e637f74e6b4e tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1218 microversion: 2.1 time: 0.110787 Jul 12 22:08:51.254572 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 191/368] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:51 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:51.786016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:51.786753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:51.794095 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:51.794550 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:51.795325 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:51.795765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:51.933543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:51.942305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0ecde199-4547-4bf8-b031-32f6f2c960f0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.160540 Jul 12 22:08:51.942885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 178/369] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:51 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:52.152923 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:52.154208 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:52.165693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.167536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:52.169528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.170631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:52.262873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:52.263543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:52.271301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.271760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:52.272571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.273036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:52.312486 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:52.324699 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:52.326525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:52.327682 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ab7fae30-e29f-43d4-90ed-3e8e2bd63b29 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.179807 Jul 12 22:08:52.328612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 192/370] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:52 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:52.342416 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:52.348970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7e37a900-6d35-495c-9b47-bdb0fcccaa37 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.090775 Jul 12 22:08:52.349616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 179/371] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:52 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:52.959403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:52.960017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:52.966398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.966913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:52.967790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:52.968294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:53.103849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:53.111384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0487c77e-b1ff-453b-981b-1885454ad92f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.156015 Jul 12 22:08:53.111949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 193/372] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:52 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:53.346254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:53.347626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:53.354959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:53.355406 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:53.356207 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:53.356650 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:53.366131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:53.366750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:53.373038 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:53.373491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:53.374266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:53.374704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:53.450693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:53.459470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8405a4c2-e0a5-4e8a-ac55-76f348677f82 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.097094 Jul 12 22:08:53.460063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 194/373] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:53 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:53.494375 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:53.502708 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:53.504737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:53.505896 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-06fdf68a-a8b9-4af4-8330-0aeb00b9f309 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.163733 Jul 12 22:08:53.506451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 180/374] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:53 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:54.129358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:54.129963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:54.135983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.136438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.137214 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.137650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.277272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:54.285355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8cd7ac39-3f69-4404-8858-a2b50ed24b75 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.159820 Jul 12 22:08:54.286044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 195/375] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:54 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:54.476629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:54.477275 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:54.483810 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.484262 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.485080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.485516 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.523710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:54.524325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:54.530849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.531300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.532073 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:54.532511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:54.547299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:54.556463 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-11a3ea91-f43b-4778-af0b-8a9110770393 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.083776 Jul 12 22:08:54.557118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 181/376] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:54 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:54.670525 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:54.679381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:54.680954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:54.682107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0546a477-69ef-4117-81f6-a76fe70f163d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.162218 Jul 12 22:08:54.682654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 196/377] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:54 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:08:55.302659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:55.303274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:55.309304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.309756 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.310513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.310950 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.445996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:55.453691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7b249ec3-c4ec-4b6d-b259-d093cc18ce5b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.154870 Jul 12 22:08:55.454260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 182/378] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:55 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:55.574718 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:55.575270 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:55.582343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.582933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.583570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.583998 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.645406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:55.652804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-be7db33a-d744-4dc6-ada1-59acdb181b58 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.082283 Jul 12 22:08:55.653369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 197/379] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:55 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:55.701080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:55.701695 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:55.710631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.711182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.711965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:55.712402 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:55.849240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:55.858372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:55.859871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:55.861117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b70c4076-37ef-47f2-a806-3f76540079ca tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.164020 Jul 12 22:08:55.861686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 183/380] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:55 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:56.471660 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:56.473156 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:56.479279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.479720 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:56.480473 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.480925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:56.619413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:56.626914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95aff40a-cc28-4436-8955-23943dc1462a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.159260 Jul 12 22:08:56.627477 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 198/381] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:56 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:56.672087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:56.672724 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:56.680276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.680748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:56.681524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.681959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:56.742840 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:56.750226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8ed87084-784b-46e7-b00b-731972187a73 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.081960 Jul 12 22:08:56.750797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 184/382] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:56 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:56.879970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:56.880631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:56.886878 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.887323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:56.888088 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:56.888521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:57.020901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:57.029315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:57.030827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:57.031979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b1994392-b272-44cd-9db3-ecf4538e8252 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.156774 Jul 12 22:08:57.032548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 199/383] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:56 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:57.644949 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:57.645796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:57.651865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:57.652335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:57.653117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:57.653559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:57.767443 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:57.768081 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:57.775180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:57.775627 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:57.776400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:57.776863 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:57.791468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:57.799018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-43032a83-92ab-479b-98e5-ea9fd3f84d9e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.158979 Jul 12 22:08:57.799590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 185/384] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:57 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:57.842475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:57.852364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1e6f6589-f6da-4de6-beec-bd24bf2253ae tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1210 microversion: 2.1 time: 0.088650 Jul 12 22:08:57.853000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 200/385] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:57 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:58.049322 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:58.049940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:58.051874 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:58.057726 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.058184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.058953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.059397 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.196481 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:58.204954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:58.207324 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:58.208489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-25b77af7-2ee8-49b5-9255-8a933177f1b7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.163090 Jul 12 22:08:58.209080 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 186/386] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:58 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:58.815716 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:58.816422 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:58.823619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.824061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.824943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.825375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.869651 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:58.870278 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:58.872306 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:58.873596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:58.880962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.881300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.882103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:58.882553 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:58.934102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:08:58.951571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:58.959463 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b91f715f-72e4-4145-bed4-2dfe56a44fef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1266 microversion: 2.1 time: 0.093524 Jul 12 22:08:58.960282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 187/387] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:58 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:08:58.972686 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:58.980360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-94b4ab01-3c37-41f4-8e72-3e9d7c5347f9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.168718 Jul 12 22:08:58.983658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 201/388] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:58 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:08:59.227421 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:59.228029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:59.234518 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:59.235065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:59.235954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:59.236468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:59.375985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:59.386224 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:59.387862 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:08:59.389139 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d489a0c5-19c4-4afa-8170-a94e65d3194c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.165569 Jul 12 22:08:59.389694 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 188/389] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:08:59 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:08:59.975979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:59.976352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:08:59.982902 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:59.983345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:59.984105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:08:59.984533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:08:59.998424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:08:59.999042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:00.006354 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:00.006804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:00.007578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:00.008021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:00.025983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:00.050665 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:00.059277 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0e6f8ff2-cfc8-410d-be26-19c77c6869e2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1266 microversion: 2.1 time: 0.087585 Jul 12 22:09:00.069445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 202/390] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:59 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:00.145414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:00.153024 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-89ad1051-33dd-40ae-80f2-4d8a9613e742 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.158632 Jul 12 22:09:00.153658 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 189/391] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:08:59 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:00.407484 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:00.408207 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:00.415862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:00.416627 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:00.417621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:00.418140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:00.423717 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:00.634676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:00.643283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:00.645532 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:00.646672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f7f80434-cae6-46ab-b69c-dcd827e9b6d4 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.243280 Jul 12 22:09:00.647224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 203/392] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:00 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:01.078373 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:01.079000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:01.087474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.088259 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.089366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.090206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.162483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:01.170203 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:01.170685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eb1374e3-ca8c-47cc-bac2-5c657cfee763 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1266 microversion: 2.1 time: 0.096925 Jul 12 22:09:01.170948 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:01.171101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 190/393] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:01 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:01.180391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.180391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.181304 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.181304 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.554414 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:01.561986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0ca2596-68b0-4149-8f53-6c9b048d8637 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.395546 Jul 12 22:09:01.562563 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 204/394] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:01 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:01.666266 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:01.666912 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:01.673192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.673804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.674890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.675393 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.807169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:01.816186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:01.817748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:01.818929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-798d32ac-7c8f-4113-b2b0-9ca1d24174b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.157163 Jul 12 22:09:01.819758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 191/395] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:01 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:01.888659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:01.889196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:01.896317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.896800 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.897565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:01.898001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:01.924162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:02.010269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a5508df4-4f95-4e44-949d-2c62de9171a7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 204 len: 0 microversion: 2.1 time: 0.125239 Jul 12 22:09:02.010933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 205/396] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:09:01 2022] DELETE /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:09:02.019631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:02.020641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.028543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.029121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.030290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.031040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.186879 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:02.192404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:02.193254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.199825 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a2243a5b-9e64-496c-ab45-18a410ba9f8b tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1512 microversion: 2.1 time: 0.184524 Jul 12 22:09:02.200769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 192/397] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:02 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:02.209247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.209713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.210487 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.210916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.291497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:02.298901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ee1fdca5-4d74-4bb7-9ea6-fcc339033df8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1272 microversion: 2.1 time: 0.111368 Jul 12 22:09:02.299470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 206/398] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:02 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:02.579461 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:02.580066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.586856 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.587277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.588027 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.588453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.718439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:02.725932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ed2e991b-0579-4329-bb9e-6daa037ca5eb tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1502 microversion: 2.1 time: 0.150305 Jul 12 22:09:02.726494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 193/399] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:02 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:02.742106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62bb2de1-3c08-4596-94de-05d8d37bb098"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:02.743302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.749375 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.749833 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.750604 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.751138 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.776861 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] HTTP exception thrown: Cannot 'attach_volume' instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c while it is in vm_state rescued Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Request method failure captured: Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/os-volume_attachments HTTP/1.1 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 74 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfCK0jfkpFCo0W6TnU05hdYQxZM7YI7muJvb-_ONZhNuPMLjq3Ys9cAdmVMpXLD4vg-FL5NwJpWRdPQ1pl0nPDNOUphy4xPxbVAzUHbpk6_eeU2x11Vaql5Bmq4KFZQQfm1BlsvnkTDudJrcMuRj2gf2Mc-oh9mHZoWNNiB2I946mEs Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:09:02.778969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b4f6be5087f4fd18a60969372480425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 309de655c8d64223a9c2d75ff5618411 Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {"volumeAttachment": {"volumeId": "62bb2de1-3c08-4596-94de-05d8d37bb098"}} Jul 12 22:09:02.780592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Cannot 'attach_volume' instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c while it is in vm_state rescued Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'server_id': '64f13d7c-c02d-4b72-90d6-8f7703ffd21c', 'body': {'volumeAttachment': {'volumeId': '62bb2de1-3c08-4596-94de-05d8d37bb098'}}} Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:02.782629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c while it is in vm_state rescued Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:02.784085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c while it is in vm_state rescued Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Returning 409 to user: Cannot 'attach_volume' instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c while it is in vm_state rescued {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-377215d8-3402-43c2-b5ed-31145385bd6b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042422 Jul 12 22:09:02.785537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 207/400] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:09:02 2022] POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 22:09:02.789528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:02.790067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.796311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.796836 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.797607 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.798042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.837935 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:02.838452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.844685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.845165 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.845933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.846363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.874037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a48f54b6-86b2-4528-a749-176c990a1e0b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/action" status: 202 len: 0 microversion: 2.1 time: 0.088272 Jul 12 22:09:02.874687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 194/401] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:09:02 2022] POST /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 22:09:02.891185 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:02.891941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:02.898607 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.899065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.899846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:02.900282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:02.993351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.002825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.004259 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.005485 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e5ac93e0-d6de-4781-9bc0-642ceafb3ada tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.171662 Jul 12 22:09:03.006424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 208/402] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:02 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:09:03.014436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3d4f878c-3ba8-48e8-b585-24203fab7dab req-a57752f5-2bd4-45d8-a45d-8225368c4aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "name": "network-vif-plugged", "status": "completed", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:03.024785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3d4f878c-3ba8-48e8-b585-24203fab7dab req-a57752f5-2bd4-45d8-a45d-8225368c4aee service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:03.025396 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3d4f878c-3ba8-48e8-b585-24203fab7dab req-a57752f5-2bd4-45d8-a45d-8225368c4aee service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:03.042216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3d4f878c-3ba8-48e8-b585-24203fab7dab req-a57752f5-2bd4-45d8-a45d-8225368c4aee service nova] Creating event network-vif-plugged:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:09:03.047174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3d4f878c-3ba8-48e8-b585-24203fab7dab req-a57752f5-2bd4-45d8-a45d-8225368c4aee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037348 Jul 12 22:09:03.047900 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 209/403] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:03.059537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.067002 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f935f480-f758-40ea-b6ea-42a00bf67de0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1510 microversion: 2.1 time: 0.187104 Jul 12 22:09:03.067797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 195/404] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:02 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:03.219610 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:03.220318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:03.226844 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:03.227284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:03.228042 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:03.228467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:03.316349 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:03.316984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:03.324063 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:03.324515 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:03.325310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:03.325743 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:03.362881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.370574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-42e9bd1c-fa5e-414f-a6ae-cf203daf05e9 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1512 microversion: 2.1 time: 0.155521 Jul 12 22:09:03.371142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 210/405] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:03 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:03.388074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:03.396531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8cfacb37-ebf7-4992-a1eb-1de1113e93f6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1272 microversion: 2.1 time: 0.084567 Jul 12 22:09:03.397132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 196/406] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:03 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:04.024337 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:04.024972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:04.031071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.031522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.032283 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.032741 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.084800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:04.085472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:04.092234 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.092692 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.093504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.093943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.170417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.180376 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.181965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.183127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e20e5eaf-187d-4f1f-9d03-5372f855f4e3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.162662 Jul 12 22:09:04.183684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 211/407] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:04 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:04.231151 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.240269 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-131e78eb-423a-40b3-a22d-5f304af8cf96 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1510 microversion: 2.1 time: 0.159428 Jul 12 22:09:04.240871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 197/408] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:04 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:04.387524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:04.388858 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:04.397978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.401208 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.402201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.402641 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.413880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:04.414831 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:04.420987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.422124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.422979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:04.423631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:04.489826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.499032 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6a9326b1-02dd-44d4-8f9e-72964e683b84 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1272 microversion: 2.1 time: 0.089748 Jul 12 22:09:04.499830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 198/409] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:04 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:04.668267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:04.677155 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dedc9dd0-eaa8-49b7-b154-e177109cbcbe tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1512 microversion: 2.1 time: 0.293361 Jul 12 22:09:04.678049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 212/410] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:04 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:05.207408 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:05.208380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:05.225648 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.226015 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.227090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.227437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.259177 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:05.259793 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:05.276302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.276832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.277732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.278222 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.572906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:05.586457 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:05.588673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:05.590407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d9004d22-9247-4696-b264-7e62930eaf36 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.388745 Jul 12 22:09:05.590890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 199/411] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:05 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:05.605809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:05.606435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:05.615075 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.615456 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.616426 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.616665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.711069 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:05.721873 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d768415d-faa6-42a3-8b20-52ae111fead8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1510 microversion: 2.1 time: 0.467275 Jul 12 22:09:05.723491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 213/412] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:05 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1510 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:05.729784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:05.730541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:05.738563 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.739321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.740351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:05.741086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:05.813144 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:05.823714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1fbe36c8-f62a-4829-a037-91c7e96a4f1d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.230940 Jul 12 22:09:05.828012 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 200/413] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:05 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:06.068668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.077992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bba656b4-5f6a-4ee8-aea0-e43d703a7271 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1512 microversion: 2.1 time: 0.353207 Jul 12 22:09:06.079536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 214/414] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:05 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:06.244876 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-ca805578-a753-4233-b0c4-7da880fcd9bb req-a1097d71-e1b1-4175-8726-75ea46e38ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7e86a8-1d55-4bb8-a02c-344f8e974058", "name": "network-vif-deleted", "tag": "6ee11d09-9d61-424f-b809-00e67450dab4"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:06.254946 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ca805578-a753-4233-b0c4-7da880fcd9bb req-a1097d71-e1b1-4175-8726-75ea46e38ed0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.255433 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ca805578-a753-4233-b0c4-7da880fcd9bb req-a1097d71-e1b1-4175-8726-75ea46e38ed0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.269502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-ca805578-a753-4233-b0c4-7da880fcd9bb req-a1097d71-e1b1-4175-8726-75ea46e38ed0 service nova] Creating event network-vif-deleted:6ee11d09-9d61-424f-b809-00e67450dab4 for instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 on hv-cinder-80295 Jul 12 22:09:06.275168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-ca805578-a753-4233-b0c4-7da880fcd9bb req-a1097d71-e1b1-4175-8726-75ea46e38ed0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Jul 12 22:09:06.276100 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 201/415] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:06.609058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:06.609669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:06.617556 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.618052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.618949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.619427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.740878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:06.741746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:06.747941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.748429 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.749227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.749667 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.751490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.761498 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.763170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.764367 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-892c1083-8adb-4756-9191-97708fdbddb0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.159456 Jul 12 22:09:06.764957 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 215/416] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:06 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:06.844289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:06.845011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:06.851221 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.851758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.852523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:06.853058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:06.884149 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.891914 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f47e3805-83dd-478b-8d97-b2e2e0f98c74 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1510 microversion: 2.1 time: 0.155926 Jul 12 22:09:06.892524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 202/417] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:06 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:06.988197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:06.995672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a935207f-5903-4a54-a6ee-605058f52785 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.155186 Jul 12 22:09:06.996235 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 216/418] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:06 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:07.097404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:07.098087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:07.104639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.105136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.105922 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.106365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.140458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.141028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.141477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lazy-loading 'fault' on Instance uuid 4e7e86a8-1d55-4bb8-a02c-344f8e974058 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:07.186654 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:07.194918 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-50f094c3-05ee-4ba8-829a-ce280274d302 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1307 microversion: 2.1 time: 0.102453 Jul 12 22:09:07.195497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 203/419] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:07 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:07.782682 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:07.783292 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:07.789890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.790338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.791102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.791540 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.909600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:07.910208 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:07.916732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.917197 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.917977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:07.918414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:07.929448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:07.938062 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:07.939891 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:07.941634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bda2ac7b-0e24-4c6d-aaec-7fddebebf7ae tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.162857 Jul 12 22:09:07.942205 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 217/420] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:07 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:08.012668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:08.013382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:08.020120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.020639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.021512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.022014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.051332 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:08.059232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ff2ce39c-1bc5-4f1c-a446-2cf0185a4388 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1510 microversion: 2.1 time: 0.153902 Jul 12 22:09:08.059811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 204/421] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:07 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:08.155184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:08.163236 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-84b8849c-9758-4dab-9370-e3b8b6f8a2d9 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.154325 Jul 12 22:09:08.172385 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 218/422] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:08 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:08.212639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:08.213300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:08.219733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.220209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.220977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.221435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.240609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:08.261147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.261702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.262376 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lazy-loading 'fault' on Instance uuid 4e7e86a8-1d55-4bb8-a02c-344f8e974058 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:08.288951 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-c00e7f97-7b14-4ae9-a093-e9b5c69c468f req-4151fa6d-6014-4e8f-ae55-bda8619cee86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90e4154-75a5-4cfb-9433-2ba3d402a28d", "tag": "f00b302f-b01b-497e-8834-6bfd9a1aaf69"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:08.297560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-c00e7f97-7b14-4ae9-a093-e9b5c69c468f req-4151fa6d-6014-4e8f-ae55-bda8619cee86 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.298422 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-c00e7f97-7b14-4ae9-a093-e9b5c69c468f req-4151fa6d-6014-4e8f-ae55-bda8619cee86 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.304409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:08.314163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-c00e7f97-7b14-4ae9-a093-e9b5c69c468f req-4151fa6d-6014-4e8f-ae55-bda8619cee86 service nova] Creating event network-changed:f00b302f-b01b-497e-8834-6bfd9a1aaf69 for instance d90e4154-75a5-4cfb-9433-2ba3d402a28d on hv-cinder-80295 Jul 12 22:09:08.321670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-c00e7f97-7b14-4ae9-a093-e9b5c69c468f req-4151fa6d-6014-4e8f-ae55-bda8619cee86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036537 Jul 12 22:09:08.323087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 219/423] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:08.341308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:08.348946 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-53383df6-dade-45a2-bd0d-1b366595fd16 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 200 len: 1307 microversion: 2.1 time: 0.140113 Jul 12 22:09:08.349527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 205/424] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:08 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:08.961253 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:08.962091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:08.971899 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.973495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:08.974335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:08.974965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.076944 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:09.077454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:09.085168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.085549 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.086548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.087015 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.112493 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:09.121263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:09.122750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:09.123902 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0c18ddf9-f035-4ce5-8b01-ba209a256db9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1808 microversion: 2.20 time: 0.168279 Jul 12 22:09:09.124459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 220/425] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:08 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:09.179224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:09.179954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:09.186166 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.186623 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.187402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.187837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.221239 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:09.229272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4f1724d9-a46d-42f1-b5eb-fc511318eac9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1516 microversion: 2.1 time: 0.156241 Jul 12 22:09:09.229927 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 206/426] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:09 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:09.326380 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:09.334451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf968a0f-5e78-4686-add0-14b4da04a4e6 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.158964 Jul 12 22:09:09.334945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 221/427] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:09 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:09.366070 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:09.366768 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: 4e7e86a8-1d55-4bb8-a02c-344f8e974058] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:09.382791 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.384160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.385003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:09.385442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:09.413690 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] HTTP exception thrown: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Request method failure captured: Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 HTTP/1.1 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfCVQcjjXjhlVcj9m1XbvcIs3V45ELrf5nozJR2pu6AMjC7pWVygKXx19GUjY3ASpDABJo5xpaStFmA7DK7SJbG0e-dJWIzhxFVYDjy2nRUzgdxxhz40lafiMd0TCYD6PfMWw-BK59OYbGbssb0ESLDUH1qQrFNSuGKUCWrZJxrjWDQ Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 39f88660bffb4d17ba8b5a7a00c3f6d3 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:09:09.416645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 39f88660bffb4d17ba8b5a7a00c3f6d3 Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesSnapshotTestJSON-1139766055-project Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4c137f9412de4914b77732e1ac29ec36 Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139766055-project Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. Jul 12 22:09:09.418343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '4e7e86a8-1d55-4bb8-a02c-344f8e974058'} Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:09.419215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. Jul 12 22:09:09.426682 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:09.428362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Returning 404 to user: Instance 4e7e86a8-1d55-4bb8-a02c-344f8e974058 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:09.428362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b1433b69-8f0f-40f0-bc21-c1ca7642b6da tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058" status: 404 len: 111 microversion: 2.1 time: 0.057761 Jul 12 22:09:09.428362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 207/428] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:09 2022] GET /compute/v2.1/servers/4e7e86a8-1d55-4bb8-a02c-344f8e974058 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:09:10.142043 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:10.142640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:10.150065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.150503 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.151266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.151694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.279521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:10.287884 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:10.289421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:10.290558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76f294ac-9e80-45b8-be6f-ebd77e068a0f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1795 microversion: 2.20 time: 0.152483 Jul 12 22:09:10.291109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 222/429] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:10 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:10.351954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:10.352725 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:10.359752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.360201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.361027 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.361464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.492458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:10.499814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-65a7e79b-c69f-4568-80c1-35f9bc99cdcf tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.151921 Jul 12 22:09:10.500368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 208/430] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:10 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:10.633421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6ecf408b-df29-4c51-9144-9618151e4191 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: .version_select at 0x7f1b6ac62e50>, body: {"keypair": {"name": "tempest-keypair-1185680446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhGeOuVL3h6wabrhavpPn0n9nMk7fbjUlY5YaG6XeX/sYTU6//4Z/h8bvWVMQ1/orNInZDBSa5y9C6B3u1dDASzPe4jr6Azr4k9BVGVRS9yMisDeozkuooG0+XqT6VVcg=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:10.647523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-6ecf408b-df29-4c51-9144-9618151e4191 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for project 4b4f6be5087f4fd18a60969372480425. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:10.651420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-6ecf408b-df29-4c51-9144-9618151e4191 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for user 309de655c8d64223a9c2d75ff5618411 and project 4b4f6be5087f4fd18a60969372480425. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:10.675227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6ecf408b-df29-4c51-9144-9618151e4191 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044987 Jul 12 22:09:10.675832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 223/431] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:09:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:10.741382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:10.742377 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:10.749221 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.750056 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.751529 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.752211 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.787796 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-29d60cce-98b3-4085-b5e0-eac6d764b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/ips" status: 200 len: 149 microversion: 2.1 time: 0.050825 Jul 12 22:09:10.788527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 209/432] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:09:10 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:10.799888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:10.801360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:10.808357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.808870 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.809652 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.810306 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.917728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/os-volume_attachments HTTP/1.1 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 74 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:09:10.919440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {"volumeAttachment": {"volumeId": "7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804"}} Jul 12 22:09:10.920689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'server_id': '654e05e7-6f82-4f9c-bc97-dbd95f40ea4d', 'body': {'volumeAttachment': {'volumeId': '7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804'}}} Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:10.921435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:10.922541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:10.925104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:10.925104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:10.925104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:10.925104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c Jul 12 22:09:10.925104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:10.926476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 400 to user: Invalid volume: volume 7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 is already attached to instances: acbee16d-55b1-4121-8fe2-023909bbef7c {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:10.927399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00035982-a762-4463-89cf-08dc265ecec1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131809 Jul 12 22:09:10.932115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 224/433] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:09:10 2022] POST /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:09:10.937404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:10.938004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:10.944859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.945688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.946543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:10.947513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:10.993491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:11.091304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b1c8245c-1737-4bb6-a38e-d666943b9aed tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 204 len: 0 microversion: 2.1 time: 0.157423 Jul 12 22:09:11.092001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 210/434] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:09:10 2022] DELETE /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 22:09:11.101546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:11.102701 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:11.104783 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:11.112509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:11.113113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:11.113989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:11.114443 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:11.315955 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:11.324149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-995b1ab4-56d8-48f0-b3a1-31a352468757 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.227751 Jul 12 22:09:11.324943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 225/435] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:11 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:11.520330 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:11.521128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:11.527813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:11.528261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:11.529067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:11.529501 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:11.770838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:11.785539 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-993db781-c003-478b-b07e-eaefdf6dc6c5 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.270366 Jul 12 22:09:11.797145 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 211/436] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:11 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:12.342495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:12.343147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:12.352831 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.353646 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.354664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.355322 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.370700 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1567559804", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acfecc3c-2e76-4d1d-82a2-18082fba1111"}], "security_groups": [{"name": "tempest-securitygroup--688067727"}], "key_name": "tempest-keypair-1185680446", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:12.494277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] validate_networks() for [('acfecc3c-2e76-4d1d-82a2-18082fba1111', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:09:12.507701 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:12.515229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d397dbc1-73d9-44ad-b3d1-6cad170eb927 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.176602 Jul 12 22:09:12.516002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 226/437] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:12 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:12.805296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:12.806414 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:12.812864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.813642 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.815515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.816319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.899103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:09:12.899754 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:09:12.900835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:09:12.901296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:09:12.901728 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:09:12.913794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.914481 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.915503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:12.915975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:12.934572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:12.938779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Getting quotas for user 309de655c8d64223a9c2d75ff5618411 and project 4b4f6be5087f4fd18a60969372480425. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:12.952264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:09:12.955108 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:09:12.962536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:12.973432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fcea7894-939c-4e62-a672-98296b031502 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.171391 Jul 12 22:09:12.975992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 227/438] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:12 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:13.010881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b3ab40af-e629-405c-a4f1-13dbc09384af tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.645539 Jul 12 22:09:13.011926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 212/439] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:09:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 22:09:13.022457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95b74f8b-6d24-45f3-a2b5-7a26c381530f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:13.023196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95b74f8b-6d24-45f3-a2b5-7a26c381530f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:13.101379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95b74f8b-6d24-45f3-a2b5-7a26c381530f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:13.113370 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95b74f8b-6d24-45f3-a2b5-7a26c381530f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1246 microversion: 2.1 time: 0.095471 Jul 12 22:09:13.114580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 228/440] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:13 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:13.535125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:13.535740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:13.542040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:13.542532 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:13.543333 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:13.543790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:13.677388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:13.687907 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d5e819e9-3ace-42f3-be3a-ad537e11aa9c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.157099 Jul 12 22:09:13.688758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 213/441] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:13 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:13.993411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:13.994492 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:14.004355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.004355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.004355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.004355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.130684 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:14.131276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:14.137758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.138218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.139066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.139579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.145889 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:14.154681 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75f06308-c51f-4efc-8cb2-54899f06f295 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.165080 Jul 12 22:09:14.155589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 229/442] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:13 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:14.210752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:14.218384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-db90f523-fd97-47f2-bc50-0d5d3938cc40 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1250 microversion: 2.1 time: 0.091706 Jul 12 22:09:14.221837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 214/443] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:14 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:14.706448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:14.707063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:14.713093 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.713547 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.714329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:14.714748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:14.845817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:14.854159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f66e67ad-0ebf-4f07-b53c-8abaa624ce2b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.152412 Jul 12 22:09:14.855960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 230/444] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:14 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:15.172316 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:15.172932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:15.179562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.180229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:15.181178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.181761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:15.238025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:15.240353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:15.276867 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.283818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:15.285779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.286471 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:15.351041 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:15.359965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eb94de6e-de70-44da-85dc-5e15715e107d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.191320 Jul 12 22:09:15.360548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 215/445] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:15 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:15.371174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:15.379372 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-309436f5-f88d-4674-a1ea-a8c27f6a683d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1242 microversion: 2.1 time: 0.147880 Jul 12 22:09:15.379939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 231/446] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:15 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:15.872737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:15.873409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:15.880522 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.880903 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:15.881924 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:15.883219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:16.011236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:16.019335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2ea1b316-2193-4fd1-bb68-3b9e6910e44b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.150628 Jul 12 22:09:16.020038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 216/447] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:15 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:16.378571 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:16.379498 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:16.387592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:16.388258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:16.389432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:16.390118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:16.397566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:16.398182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:16.404219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:16.404686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:16.405498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:16.405923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:16.470618 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:16.478732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-64b1786f-1fc6-409d-9e8b-ed03dc2dfca3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1242 microversion: 2.1 time: 0.086026 Jul 12 22:09:16.479339 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 217/448] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:16 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:16.527610 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:16.535348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-89bfdc7e-4615-4184-bedf-9dd1a21dd5ef tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.162537 Jul 12 22:09:16.535904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 232/449] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:16 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:17.037091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:17.037701 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:17.043738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.044189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.044979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.045418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.131922 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:09:17.132526 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d (ip 10.222.0.44) !!! Jul 12 22:09:17.179506 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:17.187383 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e0d4c1d7-dc33-4641-8353-cbbb2367cc6b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.154850 Jul 12 22:09:17.187999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 218/450] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:17 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:17.495634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:17.496326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:17.504451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.504958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.505721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.506151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.551458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:17.552300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:17.558576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.559106 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.559869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:17.560294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:17.571228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:17.580086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-985b5163-f392-484b-8fd3-90928b4b01a6 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1298 microversion: 2.1 time: 0.088224 Jul 12 22:09:17.581541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 233/451] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:17 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:17.692932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:17.700659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-11a47ccb-8ffa-4f6b-a9ed-be7d30ba3585 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.153152 Jul 12 22:09:17.701270 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 219/452] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:17 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:18.205688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:18.206304 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:18.212622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.213112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.213882 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.214323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.350124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:18.357849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-962bda61-1b04-4c61-b8f6-a82708f41bda tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.156252 Jul 12 22:09:18.358431 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 234/453] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:18 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:18.598271 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:18.598813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:18.605361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.605805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.606561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.606987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.673687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:18.683018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6d81e71a-c522-4e76-86df-1012f500834b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1298 microversion: 2.1 time: 0.089400 Jul 12 22:09:18.683609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 220/454] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:18 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:18.718703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:18.719319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:18.726381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.726775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.727539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:18.727974 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:18.861692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:18.869197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1730e968-4402-48d8-a120-3eaac4a440f0 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.154311 Jul 12 22:09:18.869756 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 235/455] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:18 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:19.375775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:19.376388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:19.383348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.383806 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:19.384577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.385048 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:19.704932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:19.705609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:19.713027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.713499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:19.714273 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.714713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:19.736258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:19.739895 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:19.745205 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6e226950-d7f8-4f40-9530-23a3c857e112 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.373210 Jul 12 22:09:19.745778 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 221/456] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:19 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:19.779914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:19.787511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95c5de91-2d41-43b1-ac55-288561079fb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1298 microversion: 2.1 time: 0.086476 Jul 12 22:09:19.788065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 236/457] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:19 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:19.887573 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:19.888175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:19.895677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.896127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:19.896917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:19.897474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:20.027308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:20.034958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-135033b9-be56-4efa-957f-228548703a93 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.152230 Jul 12 22:09:20.035533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 222/458] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:19 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:20.557078 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-541335657", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "networks": [{"uuid": "4ef1159c-69e5-41f7-9915-a0e86e879149"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:20.610476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] validate_networks() for [('4ef1159c-69e5-41f7-9915-a0e86e879149', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:09:20.764975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:20.765608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:20.768512 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:20.774648 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:20.775098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:20.775902 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:20.776332 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:20.921450 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:20.930018 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b22326dc-0fba-4322-ad68-f3343fe0e548 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1681 microversion: 2.1 time: 0.168974 Jul 12 22:09:20.930598 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 223/459] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:20 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:20.935495 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:20.936356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:20.942829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:20.943285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:20.944316 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:20.944876 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.012956 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:21.021445 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-bfced2a8-2e37-4a0a-8597-e8378cabe969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1304 microversion: 2.1 time: 0.089539 Jul 12 22:09:21.022309 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 224/460] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:20 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:21.052945 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:21.053582 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:21.059661 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.060103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.066157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.066660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.201500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:21.209838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5108bfec-3419-4689-9124-a9884b6ec063 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.162004 Jul 12 22:09:21.210515 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 225/461] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:21 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:21.390502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-6d0da726-0349-493b-a150-4c650b70a93f req-d061592e-a2b5-4ea6-991e-01165d861177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90e4154-75a5-4cfb-9433-2ba3d402a28d", "name": "network-vif-plugged", "status": "completed", "tag": "f00b302f-b01b-497e-8834-6bfd9a1aaf69"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:21.401452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6d0da726-0349-493b-a150-4c650b70a93f req-d061592e-a2b5-4ea6-991e-01165d861177 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.401900 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6d0da726-0349-493b-a150-4c650b70a93f req-d061592e-a2b5-4ea6-991e-01165d861177 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.416468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-6d0da726-0349-493b-a150-4c650b70a93f req-d061592e-a2b5-4ea6-991e-01165d861177 service nova] Creating event network-vif-plugged:f00b302f-b01b-497e-8834-6bfd9a1aaf69 for instance d90e4154-75a5-4cfb-9433-2ba3d402a28d on hv-cinder-80295 Jul 12 22:09:21.421672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-6d0da726-0349-493b-a150-4c650b70a93f req-d061592e-a2b5-4ea6-991e-01165d861177 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035424 Jul 12 22:09:21.422549 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 226/462] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:21.768174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:09:21.769272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:09:21.769727 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:09:21.770163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:09:21.770569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:09:21.780511 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.781051 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.781894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.782317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.800530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Getting quotas for project 39f88660bffb4d17ba8b5a7a00c3f6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:21.805148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Getting quotas for user 4c137f9412de4914b77732e1ac29ec36 and project 39f88660bffb4d17ba8b5a7a00c3f6d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:21.817551 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:09:21.820073 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:09:21.867434 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cdfe52a3-d6d4-4559-a292-08e2564836bf tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314261 Jul 12 22:09:21.868122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 237/463] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:09:21.880074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-cebab256-b07e-4df6-83b5-c6ebc413af06 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:21.881461 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-cebab256-b07e-4df6-83b5-c6ebc413af06 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:21.951953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:21.951953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:21.959072 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.961531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.962518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:21.968033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:21.975521 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-cebab256-b07e-4df6-83b5-c6ebc413af06 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:21.984545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-cebab256-b07e-4df6-83b5-c6ebc413af06 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1218 microversion: 2.1 time: 0.109965 Jul 12 22:09:21.985336 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 227/464] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:21 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:22.043179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:22.044099 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:22.055131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:22.056171 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:22.059292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:22.062411 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:22.119843 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:22.136528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edb907ac-142a-4f75-9bf5-f75d667535a3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1614 microversion: 2.1 time: 0.191474 Jul 12 22:09:22.140749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 238/465] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:21 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1614 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:22.205049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:22.219868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4f76a207-8fd8-4ad8-a2a7-7ff94983ba8a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1304 microversion: 2.1 time: 0.179788 Jul 12 22:09:22.226794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:22.227458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:22.233727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 228/466] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:22 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:22.237941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:22.238684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:22.239792 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:22.240382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:22.253788 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:22.472137 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-e7de1874-3c82-4582-8364-3842d1492854 req-1d2f6c6a-e7fe-4e32-abf4-c20fa0a55d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e05e7-6f82-4f9c-bc97-dbd95f40ea4d", "name": "network-vif-deleted", "tag": "06eea394-1971-4677-a4ef-92e4c084a209"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:22.539005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e7de1874-3c82-4582-8364-3842d1492854 req-1d2f6c6a-e7fe-4e32-abf4-c20fa0a55d99 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:22.541163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e7de1874-3c82-4582-8364-3842d1492854 req-1d2f6c6a-e7fe-4e32-abf4-c20fa0a55d99 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:22.591532 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-e7de1874-3c82-4582-8364-3842d1492854 req-1d2f6c6a-e7fe-4e32-abf4-c20fa0a55d99 service nova] Creating event network-vif-deleted:06eea394-1971-4677-a4ef-92e4c084a209 for instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d on hv-cinder-80295 Jul 12 22:09:22.604725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:22.608322 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-e7de1874-3c82-4582-8364-3842d1492854 req-1d2f6c6a-e7fe-4e32-abf4-c20fa0a55d99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140083 Jul 12 22:09:22.609216 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 229/467] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:22.616158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aa515fb6-6c7c-457a-9ae0-830e4f699d1f tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1314 microversion: 2.1 time: 0.393038 Jul 12 22:09:22.617079 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 239/468] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:22 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:23.015984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:23.026231 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:23.027973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:23.037752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.038804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.040109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.040797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.139738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:23.149135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b1495439-a53d-4d4d-ab6a-1c7357e9ea00 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1222 microversion: 2.1 time: 0.134537 Jul 12 22:09:23.151118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 230/469] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:23 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:23.161807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:23.163204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:23.173850 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.176771 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.179280 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.179634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.237288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.237984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.238818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'fault' on Instance uuid 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:23.250979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:23.251953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:23.266247 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.266847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.267625 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.268945 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.346888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:23.368683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4cd275fc-fc07-4ef6-907f-e24ac1ae37e1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 200 len: 1332 microversion: 2.1 time: 0.210971 Jul 12 22:09:23.376755 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 240/470] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:23 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 1332 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:23.578584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:23.591662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-44def975-626a-4109-8388-12aed334b36b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.340981 Jul 12 22:09:23.592670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 231/471] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:23 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:23.633956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:23.634728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:23.645911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.646658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.647454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:23.648537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:23.948200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:23.959277 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aa59e0a5-1bcb-4862-b97d-01cf3a6065a8 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1464 microversion: 2.1 time: 0.329731 Jul 12 22:09:23.972986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 241/472] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:23 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:24.023676 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.025057 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:24.046062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.046821 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.048089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.048684 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.107741 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:24.167194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.167874 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:24.188471 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.189243 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.190935 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.191542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.280064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-afa6a04d-3d75-4d9c-a20b-542c75564838 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 204 len: 0 microversion: 2.1 time: 0.259878 Jul 12 22:09:24.281038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 232/473] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:09:24 2022] DELETE /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:09:24.290468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.291488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:24.299423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.300400 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.301380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.301954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.378075 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:24.387286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6409c50-4bc6-47af-a43d-5d6506cd0f9a tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1278 microversion: 2.1 time: 0.223660 Jul 12 22:09:24.388378 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 242/474] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:24 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:24.393260 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.394072 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:24.400248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.400976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.401943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.402542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.430844 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d HTTP/1.1 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:09:24.432651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:09:24.434327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '654e05e7-6f82-4f9c-bc97-dbd95f40ea4d'} Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:24.435311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:09:24.436853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:24.438904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:24.441424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-17d0715f-9cc3-40be-b184-9482f10ecf6d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 404 len: 111 microversion: 2.1 time: 0.050375 Jul 12 22:09:24.445808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 243/475] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:24 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:09:24.452779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bc009bcf-6404-4d83-98f0-aa6a8d602176 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '.version_select at 0x7f1b6ab2cf70>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.474098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:24.476398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bc009bcf-6404-4d83-98f0-aa6a8d602176 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832925666" status: 202 len: 0 microversion: 2.1 time: 0.028630 Jul 12 22:09:24.477003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 244/476] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jul 12 22:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832925666 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 22:09:24.484457 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0d90e5e1-44be-4cd0-89a0-627edbc698de tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1470 microversion: 2.1 time: 0.198877 Jul 12 22:09:24.485478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 233/477] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:24 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:24.609964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:24.610578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:24.618700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.619155 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.619922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.620366 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.632764 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-44bb15b7-bc02-46d6-8176-d18962337e09 req-2d37515a-8b02-47f9-91e8-07fdee378ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:24.660380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-44bb15b7-bc02-46d6-8176-d18962337e09 req-2d37515a-8b02-47f9-91e8-07fdee378ed0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:24.661181 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-44bb15b7-bc02-46d6-8176-d18962337e09 req-2d37515a-8b02-47f9-91e8-07fdee378ed0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:24.676975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-44bb15b7-bc02-46d6-8176-d18962337e09 req-2d37515a-8b02-47f9-91e8-07fdee378ed0 service nova] Creating event network-changed:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:09:24.681861 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-44bb15b7-bc02-46d6-8176-d18962337e09 req-2d37515a-8b02-47f9-91e8-07fdee378ed0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052913 Jul 12 22:09:24.682463 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 234/478] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:24.894154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:24.902480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5b17bfd3-4274-4beb-90ac-62757fd3bbe4 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.296269 Jul 12 22:09:24.903203 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 245/479] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:24 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:25.251805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:25.252503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:25.258772 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.259214 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.259973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.260407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.339422 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'services' on Instance uuid acbee16d-55b1-4121-8fe2-023909bbef7c {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:25.405673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:25.406290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:25.414156 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.414613 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.415582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.415999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.416440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-dffd4504-01da-4dd5-a6ee-f74c25f2d96e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments/7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804" status: 202 len: 0 microversion: 2.1 time: 0.169165 Jul 12 22:09:25.417098 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 235/480] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:09:25 2022] DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments/7b5cbcdb-02ed-4cfa-9d9c-6ad90f7e6804 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:09:25.426189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:25.427325 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:25.434093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.434545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.435321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.435762 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.467392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1ec94dd7-4391-46c2-9d5e-41efeb081857 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Jul 12 22:09:25.468210 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 236/481] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:09:25 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:25.489791 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:25.502719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:25.503882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:25.512847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.517618 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.518779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b83f2bd7-92da-4d0d-9297-1365c91c64c7 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1288 microversion: 2.1 time: 0.115882 Jul 12 22:09:25.519468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.519985 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 246/482] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:25 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:25.523279 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.694714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:25.728206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-54417256-f271-4f05-90bd-321a5b3e9a47 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1470 microversion: 2.1 time: 0.230155 Jul 12 22:09:25.730061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 237/483] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:25 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:25.919559 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:25.920172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:25.926995 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.927447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:25.928225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:25.928665 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.170344 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:26.180986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-367cce4f-8bf3-4a50-a1c3-279ead17ac2a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.264815 Jul 12 22:09:26.181712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 247/484] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:25 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:26.482173 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:26.483980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:26.493236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.493685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.494459 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.498620 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.539179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:26.540223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:26.555685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.556688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.557928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.558598 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.565711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-361e6e6a-dc87-4a9b-8630-49e73544995c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088600 Jul 12 22:09:26.566891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 238/485] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:09:26 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:26.671537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-26529513-7206-466d-b3ff-f9f24916b0c2 req-7b9bd5c2-cb1a-470c-bf5b-0f0dd8277cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90e4154-75a5-4cfb-9433-2ba3d402a28d", "name": "network-vif-deleted", "tag": "f00b302f-b01b-497e-8834-6bfd9a1aaf69"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:26.682462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-26529513-7206-466d-b3ff-f9f24916b0c2 req-7b9bd5c2-cb1a-470c-bf5b-0f0dd8277cb3 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.683344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-26529513-7206-466d-b3ff-f9f24916b0c2 req-7b9bd5c2-cb1a-470c-bf5b-0f0dd8277cb3 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.688309 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:26.699065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-26529513-7206-466d-b3ff-f9f24916b0c2 req-7b9bd5c2-cb1a-470c-bf5b-0f0dd8277cb3 service nova] Creating event network-vif-deleted:f00b302f-b01b-497e-8834-6bfd9a1aaf69 for instance d90e4154-75a5-4cfb-9433-2ba3d402a28d on hv-cinder-80295 Jul 12 22:09:26.704229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-26529513-7206-466d-b3ff-f9f24916b0c2 req-7b9bd5c2-cb1a-470c-bf5b-0f0dd8277cb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036232 Jul 12 22:09:26.705750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 239/486] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:26.751319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:26.752382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:26.762130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.762598 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.763860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:26.764299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:26.829949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:26.833451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:26.838469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7f6b1db1-9be5-485c-ae2a-9313bf46f283 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.305207 Jul 12 22:09:26.839055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 248/487] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:26 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:26.840968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-185e7da3-db17-4507-bd64-ed1a615e6c32 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1428 microversion: 2.1 time: 0.093841 Jul 12 22:09:26.841545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 240/488] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:26 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:27.197992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:27.198596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:27.205454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.206438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.207206 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.207645 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.343625 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:27.351618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ff378eca-e8a0-49e2-90ae-86cdd9d8157a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.157783 Jul 12 22:09:27.352181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 249/489] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:27 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:27.578919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:27.579898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:27.588084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.588537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.589446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.589894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.624553 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-98081416-af4f-46aa-bc8d-b8c76afa71c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050593 Jul 12 22:09:27.625146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 241/490] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:09:27 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:09:27.684534 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:27.685092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:27.691723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.692168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.692956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.693386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.720089 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:27.834619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4df079c6-4c33-4c6e-900b-3d515ddfe0c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 204 len: 0 microversion: 2.1 time: 0.153585 Jul 12 22:09:27.835206 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 250/491] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:09:27 2022] DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:09:27.844304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:27.845128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:27.855475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.856331 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.859508 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:27.861656 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:27.862127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.862765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.880141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.880783 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:27.882014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:27.882466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.012852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:28.021275 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-84e16bf1-2dd9-4016-bcae-d58666514b1e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1679 microversion: 2.1 time: 0.181502 Jul 12 22:09:28.022051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 242/492] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:27 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:28.026243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:28.027456 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:28.033608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.034061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.034812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.035241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.067199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.067636 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.068077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lazy-loading 'fault' on Instance uuid d90e4154-75a5-4cfb-9433-2ba3d402a28d {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:28.078646 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:28.097675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-38949275-6e1a-4ded-9a7c-3e21214c3194 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.244365 Jul 12 22:09:28.098581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 251/493] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:27 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:28.112404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:28.120442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fb144325-b98f-4e4b-a949-b7fd25d05c3d tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1304 microversion: 2.1 time: 0.097584 Jul 12 22:09:28.121050 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 243/494] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:28 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:28.197668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3c92ada8-d33e-49dd-bd4f-4698b4cf4ba5 req-1f70eb48-0828-44e8-8d69-473c9801723b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40bd1e3-f36d-4624-9aaa-a12927bb49dd", "tag": "849ed244-ae35-42a3-b2ce-0663a08f2507"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:28.206502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3c92ada8-d33e-49dd-bd4f-4698b4cf4ba5 req-1f70eb48-0828-44e8-8d69-473c9801723b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.207118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3c92ada8-d33e-49dd-bd4f-4698b4cf4ba5 req-1f70eb48-0828-44e8-8d69-473c9801723b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.218088 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3c92ada8-d33e-49dd-bd4f-4698b4cf4ba5 req-1f70eb48-0828-44e8-8d69-473c9801723b service nova] Creating event network-changed:849ed244-ae35-42a3-b2ce-0663a08f2507 for instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd on hv-cinder-80295 Jul 12 22:09:28.222718 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3c92ada8-d33e-49dd-bd4f-4698b4cf4ba5 req-1f70eb48-0828-44e8-8d69-473c9801723b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029050 Jul 12 22:09:28.223320 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 252/495] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:28.368473 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:28.369137 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:28.375384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.375834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.376592 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:28.377771 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:28.509199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:28.519432 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b022a442-753c-4b5f-b4f2-4555788c6d9c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.154356 Jul 12 22:09:28.520384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 244/496] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:28 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:29.040217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:29.040940 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:29.047153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.047600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.048358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.049348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.114783 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:29.115353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:29.121693 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.122137 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.122904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.123336 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.195459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:29.204988 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5825c3c3-aa38-40d1-89e8-b044e31540ab tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1679 microversion: 2.1 time: 0.169362 Jul 12 22:09:29.215897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 253/497] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:29 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:29.222601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:29.223520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:29.241671 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.242137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.243452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.243655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.303580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.304244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.305316 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lazy-loading 'fault' on Instance uuid d90e4154-75a5-4cfb-9433-2ba3d402a28d {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:29.316340 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:29.324679 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5a0c0804-bf9a-43ef-8d8f-f4046a853539 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.214398 Jul 12 22:09:29.334923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 245/498] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:29 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:29.409835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1d7070c0db4eb4bba5e1e018da5bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86df0806e8747159530bd66cd36e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:29.422785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e19dc50e-9bd1-4c73-950c-b04a0c1b728a tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 200 len: 1304 microversion: 2.1 time: 0.204108 Jul 12 22:09:29.423706 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 254/499] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:29 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:29.539920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:29.541583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:29.550280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.550897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.551767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:29.552299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:29.691923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:29.700025 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e217bb63-d6f5-4b4d-bce9-d89e43d36984 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.163897 Jul 12 22:09:29.700787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 246/500] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:29 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:30.221596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:30.222225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:30.229545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.229986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.230742 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.231172 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.341810 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:30.342555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:30.349094 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.349643 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.350433 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.350857 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.482350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:30.489925 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-26a9ecee-4e85-400d-8b30-79ecc3f86834 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.151944 Jul 12 22:09:30.490495 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 247/501] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:30 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:30.495363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:30.496043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] [instance: d90e4154-75a5-4cfb-9433-2ba3d402a28d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:30.502541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.503102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.504017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.504524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.518552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] HTTP exception thrown: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Request method failure captured: Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d HTTP/1.1 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfDrNgY9BiXAenRom1NiALwklS-I6s1N2bKYAQNtJumSVUbLnBMdIz1-wPNZJyBNrj4zBeXSVMP5UAss_P_BfBzvpXfZwoJmVkt7niEtPGM9FLlvYIWFYWbt6_3n__-yarDFAPnoS47TT4X6aZf2UfLsGaQg5m5K3ZCkZ5IRXQ110zc Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: f86df0806e8747159530bd66cd36e7f3 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesNegativeTest-801404561 Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:09:30.520225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f86df0806e8747159530bd66cd36e7f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f86df0806e8747159530bd66cd36e7f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f86df0806e8747159530bd66cd36e7f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f86df0806e8747159530bd66cd36e7f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesNegativeTest-801404561 Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: f86df0806e8747159530bd66cd36e7f3 Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesNegativeTest-801404561 Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesNegativeTest-801404561-project Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: dc1d7070c0db4eb4bba5e1e018da5bad Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesNegativeTest-801404561-project Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. Jul 12 22:09:30.521752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'd90e4154-75a5-4cfb-9433-2ba3d402a28d'} Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:30.523129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. Jul 12 22:09:30.526274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:30.528303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] Returning 404 to user: Instance d90e4154-75a5-4cfb-9433-2ba3d402a28d could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:30.528303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f2219f83-bbd1-4f30-8161-cfce22e9cbc2 tempest-VolumesNegativeTest-801404561 tempest-VolumesNegativeTest-801404561-project] 10.222.0.44 "GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d" status: 404 len: 111 microversion: 2.1 time: 0.029926 Jul 12 22:09:30.528303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 248/502] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:30 2022] GET /compute/v2.1/servers/d90e4154-75a5-4cfb-9433-2ba3d402a28d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:09:30.538911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:30.543144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:30.551862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b906539a-8dcd-4c5d-a711-6953d79f65e2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1679 microversion: 2.1 time: 0.333812 Jul 12 22:09:30.552768 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 255/503] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:30 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:30.717790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:30.718782 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:30.725186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.725922 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.726885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:30.727511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:30.904374 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:30.915185 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0025e03c-0083-428a-a604-637bd0db5665 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.200631 Jul 12 22:09:30.916492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 249/504] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:30 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:31.177396 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a8b537c2-5920-4383-b91a-99e9462b1d64 req-7b76eb86-2574-4b2c-be4f-1616f382f006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbee16d-55b1-4121-8fe2-023909bbef7c", "name": "network-vif-deleted", "tag": "24cc7c40-57cc-4708-a7ec-372d6231f2a1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:31.186753 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a8b537c2-5920-4383-b91a-99e9462b1d64 req-7b76eb86-2574-4b2c-be4f-1616f382f006 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.187198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a8b537c2-5920-4383-b91a-99e9462b1d64 req-7b76eb86-2574-4b2c-be4f-1616f382f006 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.199983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a8b537c2-5920-4383-b91a-99e9462b1d64 req-7b76eb86-2574-4b2c-be4f-1616f382f006 service nova] Creating event network-vif-deleted:24cc7c40-57cc-4708-a7ec-372d6231f2a1 for instance acbee16d-55b1-4121-8fe2-023909bbef7c on hv-cinder-80295 Jul 12 22:09:31.207521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-a8b537c2-5920-4383-b91a-99e9462b1d64 req-7b76eb86-2574-4b2c-be4f-1616f382f006 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037866 Jul 12 22:09:31.208146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 256/505] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:31.510253 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:31.512337 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:31.519789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.520513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.521494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.521936 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.573521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:31.576431 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:31.588740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.589429 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.591105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.591915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.636127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.636531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.637013 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'fault' on Instance uuid acbee16d-55b1-4121-8fe2-023909bbef7c {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:31.691327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:31.695582 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:31.703988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1d25c14a-809e-437e-9a5c-fd1283f4e1b2 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.199885 Jul 12 22:09:31.704445 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 250/506] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:31 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:31.716342 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9c34593f-d697-45be-b2fd-9a61273612f7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 200 len: 1331 microversion: 2.1 time: 0.149261 Jul 12 22:09:31.717618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 257/507] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:31 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:31.804623 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-47a68f74-d8cf-45d6-9560-93c8c85f0de6 req-9e5cdfb0-f717-443c-b8c8-1f19088486e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "name": "network-vif-plugged", "status": "completed", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:31.834875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-47a68f74-d8cf-45d6-9560-93c8c85f0de6 req-9e5cdfb0-f717-443c-b8c8-1f19088486e1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.840452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-47a68f74-d8cf-45d6-9560-93c8c85f0de6 req-9e5cdfb0-f717-443c-b8c8-1f19088486e1 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.871339 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-47a68f74-d8cf-45d6-9560-93c8c85f0de6 req-9e5cdfb0-f717-443c-b8c8-1f19088486e1 service nova] Creating event network-vif-plugged:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:09:31.886054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-47a68f74-d8cf-45d6-9560-93c8c85f0de6 req-9e5cdfb0-f717-443c-b8c8-1f19088486e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088282 Jul 12 22:09:31.886911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 251/508] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:31.933393 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:31.934111 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:31.937312 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:31.938037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=12 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:31.960347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.962568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:31.965226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:31.968569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:32.179443 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:32.188916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-856aac7e-a3ba-4b68-bff1-9a0385966729 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.259722 Jul 12 22:09:32.190826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 258/509] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:31 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:32.718424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=8 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:32.726875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:32.726875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:32.733644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:32.734110 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:32.734420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:32.734871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:32.735032 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:32.735319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:32.745084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:32.745759 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:32.746637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:32.747216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:32.764327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c HTTP/1.1 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:09:32.766159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:09:32.768928 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'acbee16d-55b1-4121-8fe2-023909bbef7c'} Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:32.769839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:09:32.771358 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:09:32.772517 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:32.772517 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dd980902-0d24-48e3-abbc-0db47f1f755d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 404 len: 111 microversion: 2.1 time: 0.038498 Jul 12 22:09:32.773241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 259/510] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:32 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:09:32.778494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6185da5b-28bb-4048-afc0-d37eb734b77e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '.version_select at 0x7f1b6ab2c280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:32.788124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:32.805004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6185da5b-28bb-4048-afc0-d37eb734b77e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736399504" status: 202 len: 0 microversion: 2.1 time: 0.029638 Jul 12 22:09:32.806219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 260/511] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jul 12 22:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736399504 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 22:09:32.906698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:32.917497 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c30c2dff-7e0a-40c0-8a9e-5d6b14202d31 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.199893 Jul 12 22:09:32.925734 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 252/512] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:32 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:33.209113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:33.209811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:33.220267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:33.221388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:33.222401 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:33.223180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:33.381090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:33.393913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d039be0-f7cd-4c69-a010-0cff7b5be5b2 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1371 microversion: 2.1 time: 0.190140 Jul 12 22:09:33.394679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 261/513] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:33 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:33.516266 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c7bbda7f-6f3e-4939-87a7-ea20e8934051 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: .version_select at 0x7f1b66b588b0>, body: {"keypair": {"name": "tempest-keypair-573115200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL//g0lqTO30nbfh+OTIxo7YX6myLZEnfxsZYPjxw4lQT3fPGsK5/ItEft0JGDk8XssopyJxveY8zq99BV6dYjMStLewnrdqUKamj0dFzyUALFQUMloGaDlRuW0jzUvKw=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:33.534963 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-c7bbda7f-6f3e-4939-87a7-ea20e8934051 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:33.539717 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-c7bbda7f-6f3e-4939-87a7-ea20e8934051 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:33.574866 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c7bbda7f-6f3e-4939-87a7-ea20e8934051 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062389 Jul 12 22:09:33.575471 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 253/514] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:09:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:33.936747 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:33.938728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:33.947878 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:33.948330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:33.949156 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:33.949594 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:34.135548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:34.143107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-476530d8-ca6a-4f7e-bba5-a0929e10d5ff tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.211441 Jul 12 22:09:34.143660 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 262/515] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:33 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:34.410566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:34.412163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:34.418656 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:34.419147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:34.419999 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:34.420474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:34.664398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:34.672385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b8e58e60-06d6-4637-a80f-fe669d5f257a tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1564 microversion: 2.1 time: 0.266219 Jul 12 22:09:34.673215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 254/516] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:34 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:34.690642 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:34.691389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:34.698228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:34.698924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:34.699818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:34.700362 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:34.792880 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d20e67b4-1d92-412d-90e3-b8b2adc6b4d0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107171 Jul 12 22:09:34.793670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 263/517] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:09:34 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:35.122829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-327461758", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afbe5681-6e61-4873-a265-db662a1dd309"}], "security_groups": [{"name": "tempest-securitygroup--1404284233"}], "key_name": "tempest-keypair-573115200", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:35.160050 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:35.161268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:35.170293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:35.171188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:35.171984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:35.172426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:35.256424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] validate_networks() for [('afbe5681-6e61-4873-a265-db662a1dd309', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:09:35.544126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:35.554197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a6466c8f-2fe5-40a5-b35f-d83336d814b5 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.398609 Jul 12 22:09:35.555393 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 264/518] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:35 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:35.561044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7f3e3795-9e47-461d-8b1b-220536bce639 req-e7827e37-8fe3-4298-b8d5-d3da73b4fb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40bd1e3-f36d-4624-9aaa-a12927bb49dd", "name": "network-vif-plugged", "status": "completed", "tag": "849ed244-ae35-42a3-b2ce-0663a08f2507"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:35.578965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7f3e3795-9e47-461d-8b1b-220536bce639 req-e7827e37-8fe3-4298-b8d5-d3da73b4fb05 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:35.579751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7f3e3795-9e47-461d-8b1b-220536bce639 req-e7827e37-8fe3-4298-b8d5-d3da73b4fb05 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:35.593635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7f3e3795-9e47-461d-8b1b-220536bce639 req-e7827e37-8fe3-4298-b8d5-d3da73b4fb05 service nova] Creating event network-vif-plugged:849ed244-ae35-42a3-b2ce-0663a08f2507 for instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd on hv-cinder-80295 Jul 12 22:09:35.598538 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7f3e3795-9e47-461d-8b1b-220536bce639 req-e7827e37-8fe3-4298-b8d5-d3da73b4fb05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041428 Jul 12 22:09:35.599360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 265/519] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:35.672478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:09:35.673036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:09:35.673385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:09:35.674419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:09:35.674743 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:09:35.691310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:35.691799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:35.692633 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:35.693100 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:35.720284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:35.727842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:35.745745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:09:35.749054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:09:35.793351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:35.825881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e44e6228-feed-4d81-900f-6048265b0e8f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707069 Jul 12 22:09:35.826453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 255/520] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:09:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:09:35.837317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f2462a1f-786b-42a4-84b7-5e81f8806cc2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:35.838207 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f2462a1f-786b-42a4-84b7-5e81f8806cc2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:35.981836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2462a1f-786b-42a4-84b7-5e81f8806cc2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:35.991045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f2462a1f-786b-42a4-84b7-5e81f8806cc2 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1240 microversion: 2.1 time: 0.158192 Jul 12 22:09:36.002406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 266/521] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:35 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:36.234808 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-e8d446d3-4789-4a6b-836a-6770a0104b6a req-c987f8fa-7897-4789-aea3-c5b3c1d0974e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:36.247330 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e8d446d3-4789-4a6b-836a-6770a0104b6a req-c987f8fa-7897-4789-aea3-c5b3c1d0974e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:36.247872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e8d446d3-4789-4a6b-836a-6770a0104b6a req-c987f8fa-7897-4789-aea3-c5b3c1d0974e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:36.261720 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-e8d446d3-4789-4a6b-836a-6770a0104b6a req-c987f8fa-7897-4789-aea3-c5b3c1d0974e service nova] Creating event network-changed:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:09:36.267289 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-e8d446d3-4789-4a6b-836a-6770a0104b6a req-c987f8fa-7897-4789-aea3-c5b3c1d0974e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037339 Jul 12 22:09:36.268687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 256/522] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:36.571581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:36.572197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:36.579622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:36.580541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:36.581585 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:36.582183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:36.727746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:36.735132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e7eedab7-bcef-4c5b-8f32-53b173956c9f tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1318 microversion: 2.1 time: 0.167659 Jul 12 22:09:36.735696 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 267/523] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:36 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:37.012042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:37.012917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:37.021226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:37.021530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:37.022344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:37.022784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:37.090353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:37.099084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9fed77c1-0173-4793-a91e-5c72c0fda4d0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1292 microversion: 2.1 time: 0.091252 Jul 12 22:09:37.099656 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 257/524] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:37 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:37.752242 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:37.752802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:37.762397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:37.762846 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:37.763644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:37.764163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:38.085354 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:38.104185 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b78f31f9-0747-4c39-a183-805995580e21 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1508 microversion: 2.1 time: 0.355935 Jul 12 22:09:38.104805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 268/525] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:37 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:38.115858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:38.116407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:38.122873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:38.123147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cca7d488-866b-4954-9a1d-06d1fe2a5231", "device": "/dev/sdb"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:38.123321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:38.124280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:38.124656 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:38.124811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:38.133027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:38.133543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:38.134326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:38.134764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:38.191551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:38.201547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3d4f624f-5d7f-4657-99dc-3e4086223ad0 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1298 microversion: 2.1 time: 0.089274 Jul 12 22:09:38.206479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 258/526] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:38 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:38.390468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6be70f3e-d887-441b-9caf-85c038b20661 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "POST /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272273 Jul 12 22:09:38.391186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 269/527] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:09:38 2022] POST /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:39.219321 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:39.221822 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:39.230274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:39.230719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:39.232619 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:39.233257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:39.375869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:39.379628 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=100 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:39.384522 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9ce204e6-77bb-4db9-b1a3-9369a87a80b9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.169132 Jul 12 22:09:39.385322 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 259/528] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:39 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:39.419188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8f8be091-64da-40a9-ace8-c01f868c6f89 req-d488218f-aeda-48c7-8c3e-b7b4d1b2a47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce69e77a-f36b-4fcf-ba67-123c5e93f0e8", "tag": "9d9ee289-087f-4e67-9d00-1f2f16a9dfe5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:39.430559 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8f8be091-64da-40a9-ace8-c01f868c6f89 req-d488218f-aeda-48c7-8c3e-b7b4d1b2a47f service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:39.433195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8f8be091-64da-40a9-ace8-c01f868c6f89 req-d488218f-aeda-48c7-8c3e-b7b4d1b2a47f service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:39.450897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8f8be091-64da-40a9-ace8-c01f868c6f89 req-d488218f-aeda-48c7-8c3e-b7b4d1b2a47f service nova] Creating event network-changed:9d9ee289-087f-4e67-9d00-1f2f16a9dfe5 for instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 on hv-cinder-80295 Jul 12 22:09:39.456303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8f8be091-64da-40a9-ace8-c01f868c6f89 req-d488218f-aeda-48c7-8c3e-b7b4d1b2a47f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042672 Jul 12 22:09:39.460864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 270/529] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:40.402044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:40.402639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:40.409869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:40.410310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:40.411092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:40.411519 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:40.542202 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:40.549771 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a1ffda17-bfc0-4c7f-b86e-bd8c36e6ef44 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.151873 Jul 12 22:09:40.550343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 260/530] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:40 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:41.568409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:41.569516 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:41.575802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:41.576269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:41.577065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:41.577504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:41.714616 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:41.722339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a7118cd0-5c0d-41d1-b2bf-eb1ea6761f57 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.159319 Jul 12 22:09:41.722904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 271/531] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:41 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:42.739053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:42.739664 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:42.746261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:42.746705 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:42.747462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:42.747895 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:42.880106 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:42.887671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-47418889-f732-4bce-9355-951c5c177d01 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.152566 Jul 12 22:09:42.888239 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 261/532] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:42 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:43.906483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:43.907247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:43.914763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:43.915246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:43.916118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:43.916574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:44.060732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:44.068397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7addee59-9679-48ea-9c31-050e9350b72d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.167110 Jul 12 22:09:44.069714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 272/533] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:43 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:45.085694 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:45.086290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:45.092918 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:45.093366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:45.094151 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:45.094591 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:45.444875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:45.452593 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fce2a4e3-f74f-4ff1-bcb6-02b241f5b25e tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.370759 Jul 12 22:09:45.453201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 262/534] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:45 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:45.523592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f6007925-915a-4a9f-afa4-bc742b9bd939 req-ac0085c1-dd4c-4453-a8e2-dd5b7731c99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce69e77a-f36b-4fcf-ba67-123c5e93f0e8", "name": "network-vif-plugged", "status": "completed", "tag": "9d9ee289-087f-4e67-9d00-1f2f16a9dfe5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:45.532389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f6007925-915a-4a9f-afa4-bc742b9bd939 req-ac0085c1-dd4c-4453-a8e2-dd5b7731c99e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:45.533412 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f6007925-915a-4a9f-afa4-bc742b9bd939 req-ac0085c1-dd4c-4453-a8e2-dd5b7731c99e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:45.544826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f6007925-915a-4a9f-afa4-bc742b9bd939 req-ac0085c1-dd4c-4453-a8e2-dd5b7731c99e service nova] Creating event network-vif-plugged:9d9ee289-087f-4e67-9d00-1f2f16a9dfe5 for instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 on hv-cinder-80295 Jul 12 22:09:45.550237 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f6007925-915a-4a9f-afa4-bc742b9bd939 req-ac0085c1-dd4c-4453-a8e2-dd5b7731c99e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Jul 12 22:09:45.550833 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 273/535] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:46.469695 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:46.470299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:46.472145 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:46.472825 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=10 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:46.479710 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:46.480156 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:46.480981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:46.481417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:46.618854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:46.626933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0e75aba1-8f87-408a-9cff-8bf37ea5b079 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.160536 Jul 12 22:09:46.627638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 263/536] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:46 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:47.641097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:47.646147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:47.646861 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:47.653997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:47.654447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:47.655247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:47.655684 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:48.061401 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:48.072257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-07929e23-19b9-4a20-b1bd-186a9b9cef38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.431908 Jul 12 22:09:48.072843 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 274/537] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:47 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:49.088921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:49.089539 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:49.097996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:49.098650 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:49.099925 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:49.100424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:49.266885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:49.275543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9bab7ab7-1cd0-4f19-97df-2fcdaf9db8e7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.190420 Jul 12 22:09:49.276121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 264/538] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:49 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:09:50.293124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:50.293727 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:50.300903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.301350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.302284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.302746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.373365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:50.374386 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:50.381750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.382311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.383170 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.383701 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.422519 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-42c91600-d8c3-4c69-b90d-1361f37fd16e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments/550408f5-7b16-43b5-8d36-013f77a0bc2a" status: 200 len: 194 microversion: 2.20 time: 0.054611 Jul 12 22:09:50.423452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 265/539] 10.222.0.44 () {60 vars in 1453 bytes} [Tue Jul 12 22:09:50 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments/550408f5-7b16-43b5-8d36-013f77a0bc2a => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 22:09:50.453763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:50.463467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eb5f23e4-a834-4d33-a41b-87bc2e2ce73d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1366 microversion: 2.1 time: 0.174169 Jul 12 22:09:50.469859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 275/540] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:50 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:50.496185 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:50.496691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:50.503520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.503969 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.504761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.505201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.588005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lazy-loading 'services' on Instance uuid a50872f4-2ebb-4811-852b-3413585e6e7b {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:50.659220 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9b7e5cd7-121b-43dd-87d2-250a1abe257d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments/550408f5-7b16-43b5-8d36-013f77a0bc2a" status: 202 len: 0 microversion: 2.20 time: 0.166738 Jul 12 22:09:50.659873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 266/541] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jul 12 22:09:50 2022] DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments/550408f5-7b16-43b5-8d36-013f77a0bc2a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:09:50.668176 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:50.669126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:50.675408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.675966 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.676836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:50.677387 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:50.694944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:50.709745 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6cfa0fd2-6243-4db9-9b81-ba7c032df5d3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045438 Jul 12 22:09:50.710298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 276/542] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:09:50 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:09:51.488039 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:51.488751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:51.495010 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.495449 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.496229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.496658 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.627179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:51.634888 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-288d522b-88f5-4b61-be0f-8a5d808efa66 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1555 microversion: 2.1 time: 0.152282 Jul 12 22:09:51.635465 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 267/543] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:51 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:51.651802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:51.652408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:51.660575 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.661054 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.661819 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.662247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.722578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:51.723525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:51.729767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.730222 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.731001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:51.731437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:51.740188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4380c7eb-b1e6-44d7-810f-90f08900b9a6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092291 Jul 12 22:09:51.740805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 277/544] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:09:51 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:51.767842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7ded5fd9-3b8b-4acd-aa4f-78711b5b6c66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050094 Jul 12 22:09:51.768439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 268/545] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:09:51 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 22:09:52.695650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-053cf9b1-7946-47bc-9fd2-bca6fd47b6ca req-8559737b-00ce-4439-8560-693aa0d28859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce69e77a-f36b-4fcf-ba67-123c5e93f0e8", "tag": "9d9ee289-087f-4e67-9d00-1f2f16a9dfe5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:52.703857 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-053cf9b1-7946-47bc-9fd2-bca6fd47b6ca req-8559737b-00ce-4439-8560-693aa0d28859 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:52.704325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-053cf9b1-7946-47bc-9fd2-bca6fd47b6ca req-8559737b-00ce-4439-8560-693aa0d28859 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:52.715722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-053cf9b1-7946-47bc-9fd2-bca6fd47b6ca req-8559737b-00ce-4439-8560-693aa0d28859 service nova] Creating event network-changed:9d9ee289-087f-4e67-9d00-1f2f16a9dfe5 for instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 on hv-cinder-80295 Jul 12 22:09:52.721141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-053cf9b1-7946-47bc-9fd2-bca6fd47b6ca req-8559737b-00ce-4439-8560-693aa0d28859 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029915 Jul 12 22:09:52.721744 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 278/546] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:09:52.779827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:52.780818 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:52.788498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:52.788954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:52.789733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:52.790172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:52.822352 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-77a07a3e-81b8-4df1-ab2f-747584eae0cb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046692 Jul 12 22:09:52.822916 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 269/547] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:09:52 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 22:09:53.836134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:53.837164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:53.844018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:53.844468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:53.845276 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:53.845712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:53.879457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3e5ece7c-a759-433d-8d01-b173655bed23 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047989 Jul 12 22:09:53.880295 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 279/548] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:09:53 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:09:54.891128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:54.892081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:54.898736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:54.899187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:54.899961 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:54.900403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:54.929916 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0e7ab3ca-c4d5-4b20-bed3-c11d35f41e62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042802 Jul 12 22:09:54.930490 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 270/549] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:09:54 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:54.988263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:54.988791 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:54.995459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:54.995904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:54.996667 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:54.997157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:55.023981 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:55.100054 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0336140e-f2b4-436d-b12e-dc0e34b5ae5d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 204 len: 0 microversion: 2.20 time: 0.116050 Jul 12 22:09:55.100893 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 280/550] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jul 12 22:09:54 2022] DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 22:09:55.109501 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:55.110151 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:55.116789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:55.117240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:55.118006 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:55.118441 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:55.248342 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:55.256404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:55.257943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:55.259121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-348aae7e-22d3-4eba-8a05-77f62660fdc6 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.153694 Jul 12 22:09:55.259672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 271/551] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:55 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:09:56.279093 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:56.279818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:56.286781 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:56.287227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:56.287985 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:56.288419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:56.422751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:56.431246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:56.432779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:56.433924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-baad4047-93be-4e0b-8d3a-374bd480c5d8 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.159096 Jul 12 22:09:56.434473 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 281/552] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:56 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:57.452451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:57.453119 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:57.460888 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:57.461346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:57.462116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:57.462554 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:57.598333 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:57.606285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:57.607818 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:57.608988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-39a3745e-d3ac-4aec-bddb-aaf9bebb577d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 200 len: 1723 microversion: 2.20 time: 0.160439 Jul 12 22:09:57.609547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 272/553] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:57 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:09:57.743939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:57.744453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:57.751284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:57.751756 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:57.753079 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:57.753515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:57.883009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lazy-loading 'services' on Instance uuid b40bd1e3-f36d-4624-9aaa-a12927bb49dd {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:09:57.973106 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-4165e4ba-2e90-41ef-ab45-5bfb7d85f68b req-76db20aa-6327-4b72-bd5f-de938464198b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50872f4-2ebb-4811-852b-3413585e6e7b", "name": "network-vif-deleted", "tag": "93abcf63-eda4-4a91-81d1-b56dfd0e5323"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:57.981718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-4165e4ba-2e90-41ef-ab45-5bfb7d85f68b req-76db20aa-6327-4b72-bd5f-de938464198b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:57.982154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-4165e4ba-2e90-41ef-ab45-5bfb7d85f68b req-76db20aa-6327-4b72-bd5f-de938464198b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:57.995138 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-4165e4ba-2e90-41ef-ab45-5bfb7d85f68b req-76db20aa-6327-4b72-bd5f-de938464198b service nova] Creating event network-vif-deleted:93abcf63-eda4-4a91-81d1-b56dfd0e5323 for instance a50872f4-2ebb-4811-852b-3413585e6e7b on hv-cinder-80295 Jul 12 22:09:58.000420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-4165e4ba-2e90-41ef-ab45-5bfb7d85f68b req-76db20aa-6327-4b72-bd5f-de938464198b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Jul 12 22:09:58.004972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 273/554] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:09:58.011664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75c2fc1e-ced0-49b8-af31-987e5e3d8acc tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd/os-volume_attachments/cca7d488-866b-4954-9a1d-06d1fe2a5231" status: 202 len: 0 microversion: 2.1 time: 0.271432 Jul 12 22:09:58.013174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 282/555] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:09:57 2022] DELETE /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd/os-volume_attachments/cca7d488-866b-4954-9a1d-06d1fe2a5231 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:09:58.628767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:58.630236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:58.637848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:58.638298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:58.639090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:58.639525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:58.656826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b HTTP/1.1 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:09:58.659215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:09:58.660639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'a50872f4-2ebb-4811-852b-3413585e6e7b'} Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:09:58.661469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:09:58.662730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:09:58.663909 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:09:58.663909 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-61424247-7ec5-4761-a54b-4235f04461b0 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 404 len: 111 microversion: 2.20 time: 0.037030 Jul 12 22:09:58.665206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 274/556] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:09:58 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:09:58.670977 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-505281fe-2ab9-4cce-9fdf-f23e2466130c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '.version_select at 0x7f1b6ab684c0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:58.691066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-505281fe-2ab9-4cce-9fdf-f23e2466130c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958238657" status: 204 len: 0 microversion: 2.20 time: 0.024304 Jul 12 22:09:58.692151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 283/557] 10.222.0.44 () {60 vars in 1261 bytes} [Tue Jul 12 22:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958238657 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 22:09:59.137543 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:59.138298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:59.144455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:59.144957 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:59.145723 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:59.146329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:59.178425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:09:59.230626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:09:59.266365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9d32e2a1-00db-4b2e-b5e8-6e671943e126 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 204 len: 0 microversion: 2.1 time: 0.132363 Jul 12 22:09:59.266983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 275/558] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:09:59 2022] DELETE /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:09:59.275809 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:09:59.276537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:09:59.287337 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:59.287790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:59.288593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:09:59.289065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:09:59.435651 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7c379bdf-7c5c-4347-94fe-0905d401b683 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: .version_select at 0x7f1b66987ee0>, body: {"keypair": {"name": "tempest-keypair-632708549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMnozpIHR+zn6+//3txLhiTsZ+rxPh5TKKqm3hTkwr6m36AFypyyfuZtfE/yNLji/lE1SOjfFXPH4nWWwFmY6rxksXRZByOlP8SzgYmY5XTRnZKWl6iPGdbvkPC6CAgkA=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:09:59.450078 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-7c379bdf-7c5c-4347-94fe-0905d401b683 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for project 807d2d1b808448bca8aaf30389c8c571. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:09:59.452913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:09:59.454021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-7c379bdf-7c5c-4347-94fe-0905d401b683 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for user 4a746b42824c4d13a1d0b0f2c5831259 and project 807d2d1b808448bca8aaf30389c8c571. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:09:59.460480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bb335d01-7f2e-4782-a0ec-06da0b28ee7d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1514 microversion: 2.1 time: 0.188980 Jul 12 22:09:59.461244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 284/559] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:09:59 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:09:59.482008 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7c379bdf-7c5c-4347-94fe-0905d401b683 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050568 Jul 12 22:09:59.482631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 276/560] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jul 12 22:09:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 22:10:00.477929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:00.478495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:00.484798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:00.485248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:00.486574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:00.486946 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:00.631898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:00.640138 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66111e03-5b33-4df6-b3cc-25774abb5c37 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1514 microversion: 2.1 time: 0.166427 Jul 12 22:10:00.641073 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 285/561] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:00 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:00.788346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1092306908", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e029eadb-c9d8-4233-ad24-02330e3aa8fe"}], "security_groups": [{"name": "tempest-securitygroup--1205754086"}], "key_name": "tempest-keypair-632708549", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:00.905146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] validate_networks() for [('e029eadb-c9d8-4233-ad24-02330e3aa8fe', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:10:01.279968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:10:01.280518 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:10:01.281096 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:10:01.281574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:10:01.281986 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:10:01.291795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:01.292167 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:01.292995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:01.293435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:01.310524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for project 807d2d1b808448bca8aaf30389c8c571. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:10:01.314677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Getting quotas for user 4a746b42824c4d13a1d0b0f2c5831259 and project 807d2d1b808448bca8aaf30389c8c571. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:10:01.327031 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:10:01.329420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:10:01.376923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-58200dd6-0cc4-46d3-a27f-bbac0aa950a5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.593662 Jul 12 22:10:01.382511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 277/562] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jul 12 22:10:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 22:10:01.387643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:01.388257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:01.509336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:01.517757 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:01.519481 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:01.521136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2556330e-0407-4e6d-af8f-556458f2bcda tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1281 microversion: 2.20 time: 0.137209 Jul 12 22:10:01.534118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 286/563] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:01 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1281 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:01.658274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:01.661314 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:01.671038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:01.671351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:01.672146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:01.672805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:01.839986 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:01.851901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f643a28a-a79b-44d6-b9c0-f6ef0a3a719d tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1514 microversion: 2.1 time: 0.197876 Jul 12 22:10:01.854045 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 278/564] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:01 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:02.075998 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f4bff07d-6067-4069-aa76-37a408566900 req-dfb56604-0f11-43ad-9941-7ed0ecddf4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40bd1e3-f36d-4624-9aaa-a12927bb49dd", "name": "network-vif-deleted", "tag": "849ed244-ae35-42a3-b2ce-0663a08f2507"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:02.085875 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f4bff07d-6067-4069-aa76-37a408566900 req-dfb56604-0f11-43ad-9941-7ed0ecddf4d0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.086414 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f4bff07d-6067-4069-aa76-37a408566900 req-dfb56604-0f11-43ad-9941-7ed0ecddf4d0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.097555 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f4bff07d-6067-4069-aa76-37a408566900 req-dfb56604-0f11-43ad-9941-7ed0ecddf4d0 service nova] Creating event network-vif-deleted:849ed244-ae35-42a3-b2ce-0663a08f2507 for instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd on hv-cinder-80295 Jul 12 22:10:02.102168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f4bff07d-6067-4069-aa76-37a408566900 req-dfb56604-0f11-43ad-9941-7ed0ecddf4d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029853 Jul 12 22:10:02.102747 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 287/565] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:02.539514 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:02.540124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:02.546327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.546777 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.547537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.547973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.611089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:02.619444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:02.620988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:02.622298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-73b81326-4420-4738-a800-e5e217ed799b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1341 microversion: 2.20 time: 0.086731 Jul 12 22:10:02.622858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 279/566] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:02 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:10:02.874958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:02.876170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:02.886127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.886841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.888035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.888703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.921823 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:02.922272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:02.922722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lazy-loading 'fault' on Instance uuid b40bd1e3-f36d-4624-9aaa-a12927bb49dd {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:10:02.971457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c137f9412de4914b77732e1ac29ec36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f88660bffb4d17ba8b5a7a00c3f6d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:02.981307 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-870a10f6-bb14-47ba-a62a-36218b9511c0 tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 200 len: 1308 microversion: 2.1 time: 0.112280 Jul 12 22:10:02.994031 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 288/567] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:02 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:03.647466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:03.648752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:03.658747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:03.659206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:03.660343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:03.661048 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:03.816686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:03.826187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:03.827770 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:03.828992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-855d962a-7e00-483e-b19c-ae555a582622 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.187506 Jul 12 22:10:03.830435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 280/568] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:03 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:03.999653 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:04.000961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] [instance: b40bd1e3-f36d-4624-9aaa-a12927bb49dd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:04.003816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:04.012944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:04.013436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:04.014229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:04.014679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:04.032094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] HTTP exception thrown: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Request method failure captured: Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd HTTP/1.1 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfCVQcjjXjhlVcj9m1XbvcIs3V45ELrf5nozJR2pu6AMjC7pWVygKXx19GUjY3ASpDABJo5xpaStFmA7DK7SJbG0e-dJWIzhxFVYDjy2nRUzgdxxhz40lafiMd0TCYD6PfMWw-BK59OYbGbssb0ESLDUH1qQrFNSuGKUCWrZJxrjWDQ Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 39f88660bffb4d17ba8b5a7a00c3f6d3 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:10:04.034202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/39f88660bffb4d17ba8b5a7a00c3f6d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 39f88660bffb4d17ba8b5a7a00c3f6d3 Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139766055 Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotTestJSON-1139766055-project Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 4c137f9412de4914b77732e1ac29ec36 Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139766055-project Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. Jul 12 22:10:04.035507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'b40bd1e3-f36d-4624-9aaa-a12927bb49dd'} Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:10:04.036212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. Jul 12 22:10:04.037428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:04.038440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] Returning 404 to user: Instance b40bd1e3-f36d-4624-9aaa-a12927bb49dd could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:10:04.038440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41f36e7e-a036-43db-adbb-8c7430fff5cb tempest-VolumesSnapshotTestJSON-1139766055 tempest-VolumesSnapshotTestJSON-1139766055-project] 10.222.0.44 "GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd" status: 404 len: 111 microversion: 2.1 time: 0.040106 Jul 12 22:10:04.045119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 289/569] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:03 2022] GET /compute/v2.1/servers/b40bd1e3-f36d-4624-9aaa-a12927bb49dd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:10:04.381853 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-eef47f2c-e877-4758-9870-7e951feda859 req-ea919850-6fb1-4d8b-96cf-4ba425dfbd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:04.393511 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-eef47f2c-e877-4758-9870-7e951feda859 req-ea919850-6fb1-4d8b-96cf-4ba425dfbd54 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:04.407280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-eef47f2c-e877-4758-9870-7e951feda859 req-ea919850-6fb1-4d8b-96cf-4ba425dfbd54 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:04.430200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-eef47f2c-e877-4758-9870-7e951feda859 req-ea919850-6fb1-4d8b-96cf-4ba425dfbd54 service nova] Creating event network-changed:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:10:04.435567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-eef47f2c-e877-4758-9870-7e951feda859 req-ea919850-6fb1-4d8b-96cf-4ba425dfbd54 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057316 Jul 12 22:10:04.436739 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 281/570] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:04.848418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:04.849063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:04.857765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:04.858225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:04.861248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:04.861938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:05.001437 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:05.010469 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:05.013592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:05.013592 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf59572a-ddeb-4147-99ee-78691da1d943 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.168789 Jul 12 22:10:05.013986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 290/571] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:04 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:06.032075 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:06.032793 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:06.039629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:06.040071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:06.040855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:06.041289 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:06.172472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:06.181242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:06.182739 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:06.183847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-97eb57c5-2caa-43c6-b77b-3ebca236a0d7 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.156520 Jul 12 22:10:06.184403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 282/572] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:06 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:10:07.202775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:07.203445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:07.216499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:07.216986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:07.217764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:07.218201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:07.362929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:07.371146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:07.372659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:07.373796 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-80937799-4f4b-4c8a-9934-2b0a5e808e6e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.175067 Jul 12 22:10:07.374354 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 291/573] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:07 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:08.393237 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:08.394685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:08.397389 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:08.402977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:08.403421 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:08.404492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:08.404959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:08.545069 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:08.554211 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:08.556093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:08.557379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b1093230-e4f4-4ec7-8459-d6970e9738f9 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.168371 Jul 12 22:10:08.558019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 283/574] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:08 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:09.575490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:09.576132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:09.582912 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:09.583362 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:09.584168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:09.584644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:09.650757 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-dd154cc1-edd7-4bd0-b9d6-3be219bffe47 req-15b3eb02-a4e1-4ca2-adc1-b2d440245334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "name": "network-vif-plugged", "status": "completed", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:09.660368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-dd154cc1-edd7-4bd0-b9d6-3be219bffe47 req-15b3eb02-a4e1-4ca2-adc1-b2d440245334 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:09.661063 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-dd154cc1-edd7-4bd0-b9d6-3be219bffe47 req-15b3eb02-a4e1-4ca2-adc1-b2d440245334 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:09.676507 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-dd154cc1-edd7-4bd0-b9d6-3be219bffe47 req-15b3eb02-a4e1-4ca2-adc1-b2d440245334 service nova] Creating event network-vif-plugged:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:10:09.681708 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-dd154cc1-edd7-4bd0-b9d6-3be219bffe47 req-15b3eb02-a4e1-4ca2-adc1-b2d440245334 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034665 Jul 12 22:10:09.682526 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 284/575] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:10:09.727634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:09.737289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:09.738888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:09.740117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1c69c0e0-a66c-414d-bd8a-9282a37c5c64 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.168517 Jul 12 22:10:09.740598 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 292/576] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:09 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:10.759940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:10.760681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:10.766995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:10.767545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:10.768379 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:10.768851 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:10.899414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:10.907296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:10.909363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:10.910500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d4cd5a63-138e-4188-8c96-2be2634278eb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1407 microversion: 2.20 time: 0.156203 Jul 12 22:10:10.911065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 285/577] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:10 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:11.929323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:11.929930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:11.932292 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:11.938303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:11.938747 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:11.940137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:11.940567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:12.069937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:12.077785 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:12.079311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:12.080882 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0fae2914-bc18-4be9-9fb2-7671ca6a1595 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1599 microversion: 2.20 time: 0.155138 Jul 12 22:10:12.081436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 293/578] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:11 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:12.098468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:12.098990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:12.101004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:12.101746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=10 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:12.108380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:12.108864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:12.109638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:12.110082 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:12.190079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-435a5487-e3b8-489c-b4df-058d51d8b86f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095947 Jul 12 22:10:12.190673 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 286/579] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jul 12 22:10:12 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:10:13.129102 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-0ef6750c-147c-4b0e-ad44-0068f8e49892 req-57161a75-b0dd-42b9-b903-2564668e83ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:13.137687 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0ef6750c-147c-4b0e-ad44-0068f8e49892 req-57161a75-b0dd-42b9-b903-2564668e83ea service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:13.138233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0ef6750c-147c-4b0e-ad44-0068f8e49892 req-57161a75-b0dd-42b9-b903-2564668e83ea service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:13.150189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-0ef6750c-147c-4b0e-ad44-0068f8e49892 req-57161a75-b0dd-42b9-b903-2564668e83ea service nova] Creating event network-changed:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:10:13.155233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-0ef6750c-147c-4b0e-ad44-0068f8e49892 req-57161a75-b0dd-42b9-b903-2564668e83ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030709 Jul 12 22:10:13.155904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 294/580] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:19.919295 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54e062db-3bf8-42bd-b2bf-5d186571454a"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:19.920390 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:19.926592 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:19.927043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:19.927814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:19.928257 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:20.164090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3e38754a-4604-463b-9c2d-6ab17102cd1b tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249262 Jul 12 22:10:20.164718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 287/581] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:10:19 2022] POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:26.623254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=11 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:26.624395 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:26.629802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:26.630847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:26.638530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:26.638979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:26.639749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:26.640185 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:26.664595 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lazy-loading 'flavor' on Instance uuid 889eb530-e983-41f7-ab72-7fe91972b910 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:10:26.800264 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-118c81c5-2022-4f2d-bbbd-38429133a54e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/action" status: 200 len: 32 microversion: 2.1 time: 0.178284 Jul 12 22:10:26.805029 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 295/582] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:10:26 2022] POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:10:26.812341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:26.813474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:26.821917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:26.822764 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:26.823826 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:26.824271 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:26.988780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:26.997151 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f881eb3e-0b57-4187-98f8-67dfff98f917 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.190433 Jul 12 22:10:26.997924 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 288/583] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:26 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:28.016140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:28.017517 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:28.023797 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:28.024255 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:28.025069 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:28.025518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:28.231549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:28.240901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02cc390c-1bdb-4854-b257-92599b0b990c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.229232 Jul 12 22:10:28.241404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 296/584] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:28 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:29.259689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:29.261364 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:29.269801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:29.270531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:29.271641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:29.272243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:29.276473 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:29.434546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:29.449652 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b4321b23-ff47-4868-9076-9ab6002dafc9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.194222 Jul 12 22:10:29.462141 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 289/585] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:29 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:30.467526 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:30.468763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:30.477834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:30.478183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:30.478966 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:30.479414 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:30.986569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:30.995907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-de7adb93-db61-4c1f-9042-4bcd657630bd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.532217 Jul 12 22:10:31.006956 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 297/586] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:30 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:32.014005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:32.015424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:32.022578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:32.023043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:32.024274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:32.024274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:32.206616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:32.215176 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-48690a36-65a0-4436-b563-21747c7f44dd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.205032 Jul 12 22:10:32.224846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 290/587] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:32 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:33.235561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:33.236958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:33.243557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:33.244258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:33.245225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:33.245841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:33.437176 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:33.449764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a654fbd6-ad2c-461d-a752-4c4e8728d94c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.218110 Jul 12 22:10:33.456782 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 298/588] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:33 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:34.468864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:34.471118 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:34.480416 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:34.481880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:34.483576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:34.484196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:34.739960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:34.751767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4333ab7d-f86c-4947-a0f3-57adf33b9743 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.287186 Jul 12 22:10:34.753157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 291/589] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:34 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:35.769931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:35.771035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:35.778961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:35.789554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:35.791095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:35.791851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:36.039569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:36.055591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15fd242f-1ef5-48b3-b7d0-59dac3c8755d tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.288881 Jul 12 22:10:36.060290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 299/590] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:35 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:36.357974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:36.359267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:36.369168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:36.369835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:36.373973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:36.374609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:36.424756 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-196ac3e6-6258-4dce-9810-5a0e3f8e2676 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/ips" status: 200 len: 149 microversion: 2.1 time: 0.080036 Jul 12 22:10:36.428900 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 292/591] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:10:36 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/ips => generated 149 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:37.076144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:37.077333 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:37.086059 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:37.086635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:37.087340 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:37.087953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:37.335553 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:37.344558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-64a194eb-54d1-4ee1-8322-0ff15e803f6c tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.274184 Jul 12 22:10:37.345399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 300/592] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:37 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:37.745929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9d032356-e6ce-41f9-8f68-dbb514950fbc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Action: 'create', calling method: .version_select at 0x7f1b66a30ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1581295142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4CHZNYTXE3qRi0kN7+JL64QLDGmIJlQR1NyctfKTqUSuCpGRiPKNlWnZOzTLrvkb94MOeEr1Xr2jE5ikeAkbGT5oobrwF7ZSq1KKyvom2CU3H19QNihQm5+oWBLZ7fYg=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:37.760897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9d032356-e6ce-41f9-8f68-dbb514950fbc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for project 80e867d86756459f9e4f53a4238d393d. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:10:37.765353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9d032356-e6ce-41f9-8f68-dbb514950fbc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for user 24a41c09f2e4487f9897c9888a0d752f and project 80e867d86756459f9e4f53a4238d393d. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:10:37.791182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9d032356-e6ce-41f9-8f68-dbb514950fbc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.229298 Jul 12 22:10:37.791919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 293/593] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:10:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:10:37.906577 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e197c773-390d-4fb8-9ea4-8f1215ba48e5"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:37.907791 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:37.915213 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:37.915665 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:37.916634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:37.917184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:38.362120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:38.362753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:38.369258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:38.369781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:38.370485 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:38.370919 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:38.589700 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:38.599154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-983491d6-a043-4be8-a3aa-951cc04f9cb1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.241395 Jul 12 22:10:38.599748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 294/594] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:38 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:38.723167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-63e6b10a-4363-44d6-8985-1343a67a46a7 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820604 Jul 12 22:10:38.723987 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 301/595] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:10:37 2022] POST /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:39.617402 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:39.618155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:39.620452 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:39.627491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:39.627904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:39.628688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:39.629169 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:39.764874 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:39.775781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e1a1a9ee-b4ef-404d-84b1-ab6a780c4969 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1734 microversion: 2.1 time: 0.162210 Jul 12 22:10:39.776408 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 295/596] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:39 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:40.794454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:40.794984 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:40.802480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:40.803106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:40.803990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:40.804530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.067248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:41.080593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3427a20a-b70e-443f-bbcf-d5b18fd30b11 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1714 microversion: 2.1 time: 0.290220 Jul 12 22:10:41.081490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 302/597] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:40 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1714 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:41.201759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:41.202221 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:41.209895 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.210347 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.211130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.211569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.450509 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] HTTP exception thrown: Cannot 'detach_volume' instance 889eb530-e983-41f7-ab72-7fe91972b910 while it is in vm_state rescued Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Request method failure captured: Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments/54e062db-3bf8-42bd-b2bf-5d186571454a HTTP/1.1 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfCK0jfkpFCo0W6TnU05hdYQxZM7YI7muJvb-_ONZhNuPMLjq3Ys9cAdmVMpXLD4vg-FL5NwJpWRdPQ1pl0nPDNOUphy4xPxbVAzUHbpk6_eeU2x11Vaql5Bmq4KFZQQfm1BlsvnkTDudJrcMuRj2gf2Mc-oh9mHZoWNNiB2I946mEs Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:10:41.452153 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b4f6be5087f4fd18a60969372480425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 309de655c8d64223a9c2d75ff5618411 Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:10:41.454599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Cannot 'detach_volume' instance 889eb530-e983-41f7-ab72-7fe91972b910 while it is in vm_state rescued Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'server_id': '889eb530-e983-41f7-ab72-7fe91972b910', 'id': '54e062db-3bf8-42bd-b2bf-5d186571454a'} Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 889eb530-e983-41f7-ab72-7fe91972b910 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:10:41.456136 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 889eb530-e983-41f7-ab72-7fe91972b910 while it is in vm_state rescued Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 889eb530-e983-41f7-ab72-7fe91972b910 while it is in vm_state rescued Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:41.457688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Returning 409 to user: Cannot 'detach_volume' instance 889eb530-e983-41f7-ab72-7fe91972b910 while it is in vm_state rescued {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:10:41.458800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3bd2cb48-ee6e-4b1f-a141-9e471e3cf4d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments/54e062db-3bf8-42bd-b2bf-5d186571454a" status: 409 len: 152 microversion: 2.1 time: 0.256231 Jul 12 22:10:41.458800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 296/598] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:10:41 2022] DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments/54e062db-3bf8-42bd-b2bf-5d186571454a => generated 152 bytes in 258 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 22:10:41.464222 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:41.467667 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:41.474186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.474723 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.475567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.476087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.557136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-84e345cf-7d03-4793-97a2-bb65f6122c98 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/action" status: 202 len: 0 microversion: 2.1 time: 0.096334 Jul 12 22:10:41.557775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 303/599] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:10:41 2022] POST /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:10:41.568203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:41.569306 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:41.577932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.578491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.579566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:41.580007 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:41.809886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:41.823041 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-95f0667d-6f9d-44e9-9e8c-5207bba0a121 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1722 microversion: 2.1 time: 0.260489 Jul 12 22:10:41.824234 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 297/600] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:41 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:42.845455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:42.846188 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:42.852788 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:42.853242 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:42.854039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:42.854476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:42.998697 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:43.007363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e5569cc4-a691-418c-a58c-355aedf51096 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1722 microversion: 2.1 time: 0.167165 Jul 12 22:10:43.007955 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 304/601] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:42 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:44.025305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:44.025935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:44.033527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:44.034009 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:44.034755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:44.035210 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:44.171536 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:44.181115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-374f731a-80e7-4745-b772-8875d2daf666 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1722 microversion: 2.1 time: 0.159860 Jul 12 22:10:44.181736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 298/602] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:44 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:45.199490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:45.200099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:45.208029 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:45.208483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:45.209488 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:45.209934 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:45.362131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:45.374131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7d71df8a-d391-4538-a049-0f60a2189799 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1728 microversion: 2.1 time: 0.178354 Jul 12 22:10:45.374987 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 305/603] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:45 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:45.392533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:45.393264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:45.402219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:45.402513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:45.403291 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:45.403745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:45.493384 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6d8f2dbd-f2eb-44f8-8f71-f231888bb2c0 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105508 Jul 12 22:10:45.494241 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 299/604] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:10:45 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:46.301921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e197c773-390d-4fb8-9ea4-8f1215ba48e5"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:46.303118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:46.310180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.310626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.311394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.311834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.409668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments HTTP/1.1 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 74 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:10:46.412153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {"volumeAttachment": {"volumeId": "e197c773-390d-4fb8-9ea4-8f1215ba48e5"}} Jul 12 22:10:46.413803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'server_id': 'ce69e77a-f36b-4fcf-ba67-123c5e93f0e8', 'body': {'volumeAttachment': {'volumeId': 'e197c773-390d-4fb8-9ea4-8f1215ba48e5'}}} Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:46.414557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:46.415674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 400 to user: Invalid volume: volume e197c773-390d-4fb8-9ea4-8f1215ba48e5 is already attached to instances: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edfa955a-9215-48b8-b98c-e0eac21e96e4 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117393 Jul 12 22:10:46.416842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 306/605] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:10:46 2022] POST /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:10:46.497103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:46.499083 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-913110da-53a5-457e-9696-97114185570a req-c920b36a-1d23-4b03-bfc6-e216e5e6d3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:46.502338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:46.515502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.516484 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.517295 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.517731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.521647 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-913110da-53a5-457e-9696-97114185570a req-c920b36a-1d23-4b03-bfc6-e216e5e6d3fe service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.522136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:46.522735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-913110da-53a5-457e-9696-97114185570a req-c920b36a-1d23-4b03-bfc6-e216e5e6d3fe service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.540433 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-913110da-53a5-457e-9696-97114185570a req-c920b36a-1d23-4b03-bfc6-e216e5e6d3fe service nova] Creating event network-changed:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:10:46.546236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-913110da-53a5-457e-9696-97114185570a req-c920b36a-1d23-4b03-bfc6-e216e5e6d3fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070654 Jul 12 22:10:46.547478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 300/606] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:10:46.614265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'services' on Instance uuid ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:10:46.711281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f781976d-735d-4640-84cc-532536731fcc tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments/e197c773-390d-4fb8-9ea4-8f1215ba48e5" status: 202 len: 0 microversion: 2.1 time: 0.215844 Jul 12 22:10:46.712194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 307/607] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:10:46 2022] DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments/e197c773-390d-4fb8-9ea4-8f1215ba48e5 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:10:46.740071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:46.747078 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:46.770443 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.771510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.773770 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:46.774970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:46.837119 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-524df9fc-7742-4af1-8531-565e1d7afcd1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106733 Jul 12 22:10:46.840872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 301/608] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:10:46 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:47.849440 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:47.850371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:47.857476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:47.857924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:47.858698 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:47.859125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:47.890558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-588a2303-bbde-4656-84b7-1a9af305e904 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045320 Jul 12 22:10:47.891215 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 308/609] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:10:47 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:10:47.956464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:47.957037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:47.959499 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:47.965928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:47.966382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:47.967167 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:47.967604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:47.995966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:10:48.083304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-380ecbd9-48e0-4eab-ae69-d34bd672c89a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 204 len: 0 microversion: 2.1 time: 0.130564 Jul 12 22:10:48.083967 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 302/610] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:10:47 2022] DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:10:48.092935 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:48.093696 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:48.101932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:48.101932 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:48.102647 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:48.103084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:48.252648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:48.260249 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2472d412-a9e7-4e65-927c-107173f9b335 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1680 microversion: 2.1 time: 0.171680 Jul 12 22:10:48.260840 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 309/611] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:48 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:48.564501 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-5e912276-abc9-4595-9219-1a2882d69797 req-fe518d88-d0dd-48f3-ba88-727b055c3add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:48.574006 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-5e912276-abc9-4595-9219-1a2882d69797 req-fe518d88-d0dd-48f3-ba88-727b055c3add service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:48.574453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-5e912276-abc9-4595-9219-1a2882d69797 req-fe518d88-d0dd-48f3-ba88-727b055c3add service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:48.586417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-5e912276-abc9-4595-9219-1a2882d69797 req-fe518d88-d0dd-48f3-ba88-727b055c3add service nova] Creating event network-changed:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:10:48.591499 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-5e912276-abc9-4595-9219-1a2882d69797 req-fe518d88-d0dd-48f3-ba88-727b055c3add service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Jul 12 22:10:48.592109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 303/612] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:10:49.268904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:49.269450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:49.276144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:49.276589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:49.277376 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:49.277871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:49.278385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:49.279171 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:49.286372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:49.287412 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:49.288351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:49.288881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:49.305318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5f02e8aa-f15d-4a64-bb20-8c0bab1c2ef5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/ips" status: 200 len: 151 microversion: 2.20 time: 0.041907 Jul 12 22:10:49.305898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 310/613] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jul 12 22:10:49 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:10:49.436263 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:49.446930 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-dac2405c-390f-46cb-8e00-7386113aa070 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1680 microversion: 2.1 time: 0.173053 Jul 12 22:10:49.447602 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 304/614] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:49 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:50.466798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:50.468565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:50.475231 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:50.475779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:50.476621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:50.477158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:50.685413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:50.694622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dc444856-95d3-4558-8b1f-e90ca45a95f8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1680 microversion: 2.1 time: 0.233576 Jul 12 22:10:50.695193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 311/615] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:50 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:51.262872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-ea479b6b-0ba9-4e17-9668-0436461058e4 req-b0a31f3c-b121-4771-926b-322e792351b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce69e77a-f36b-4fcf-ba67-123c5e93f0e8", "name": "network-vif-deleted", "tag": "9d9ee289-087f-4e67-9d00-1f2f16a9dfe5"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:51.275629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ea479b6b-0ba9-4e17-9668-0436461058e4 req-b0a31f3c-b121-4771-926b-322e792351b8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:51.276143 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ea479b6b-0ba9-4e17-9668-0436461058e4 req-b0a31f3c-b121-4771-926b-322e792351b8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:51.288970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-ea479b6b-0ba9-4e17-9668-0436461058e4 req-b0a31f3c-b121-4771-926b-322e792351b8 service nova] Creating event network-vif-deleted:9d9ee289-087f-4e67-9d00-1f2f16a9dfe5 for instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 on hv-cinder-80295 Jul 12 22:10:51.294427 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-ea479b6b-0ba9-4e17-9668-0436461058e4 req-b0a31f3c-b121-4771-926b-322e792351b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037488 Jul 12 22:10:51.295662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 305/616] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:51.713413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:51.714218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:51.722771 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:51.723321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:51.724106 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:51.724543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:51.760211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:51.760661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:51.761318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'fault' on Instance uuid ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:10:51.840510 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:51.853752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a8519a75-36e9-485e-9002-dffd4bfc6f77 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 200 len: 1330 microversion: 2.1 time: 0.144401 Jul 12 22:10:51.854441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 312/617] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:51 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:52.159129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:52.159759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:52.166560 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.167017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.167797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.168233 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.197495 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lazy-loading 'flavor' on Instance uuid 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:10:52.240003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:52.473987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ccce1855-3808-4f33-a1e9-059b60f19bf1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/action" status: 202 len: 0 microversion: 2.20 time: 0.319256 Jul 12 22:10:52.475423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 306/618] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jul 12 22:10:52 2022] POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:10:52.482839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:52.483599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:52.490403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.490886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.491728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.492166 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.634908 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:52.647134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:52.649334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:52.650807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e868eaf4-b1f0-4cf3-9188-a67f39ad8811 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.171915 Jul 12 22:10:52.651365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 313/619] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:52 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:52.876619 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:52.877357 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:52.883993 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.884346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.885148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:52.885598 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:52.899943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 HTTP/1.1 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:10:52.901617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:10:52.903051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'ce69e77a-f36b-4fcf-ba67-123c5e93f0e8'} Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:10:52.903892 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:10:52.905217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:10:52.906300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:10:52.906300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c69b95db-56bd-4a20-a359-7b4c7baf1812 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 404 len: 111 microversion: 2.1 time: 0.031321 Jul 12 22:10:52.906300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 307/620] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:52 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:10:52.912131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f9d618-692b-4bfe-9d29-6a19615d1dd6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '.version_select at 0x7f1b6aaedc10>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:52.929632 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6f9d618-692b-4bfe-9d29-6a19615d1dd6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573115200" status: 202 len: 0 microversion: 2.1 time: 0.021456 Jul 12 22:10:52.930198 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 314/621] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jul 12 22:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573115200 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:10:53.553004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-bccb1e6d-c252-45f8-945b-089acddc82ef tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: .version_select at 0x7f1b669b88b0>, body: {"keypair": {"name": "tempest-keypair-1603546043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj4pPUrtwTjDni/7KBTfRjQPl6Ab07bvv+7IPjWivo2q83L+l/MGXYZbXOriKL8J7N2OycC1CeRP+WulVgH0VAgm2+ACRx0DDAYLtFf7vtUeQ5uR9DAae5QtkDLRXLK9w=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:53.569744 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-bccb1e6d-c252-45f8-945b-089acddc82ef tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:10:53.573681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-bccb1e6d-c252-45f8-945b-089acddc82ef tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:10:53.596062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-bccb1e6d-c252-45f8-945b-089acddc82ef tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046928 Jul 12 22:10:53.596850 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 308/622] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:10:53.669499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:53.670129 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:53.677749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:53.678290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:53.679182 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:53.679767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:53.854400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:53.865090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:53.866630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:53.867887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6030ff7-fa45-4217-92ee-bb3c29b60200 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.202283 Jul 12 22:10:53.868530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 315/623] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:53 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:54.477154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1997053990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1581295142", "security_groups": [{"name": "tempest-secgroup-smoke-1104170630"}], "block_device_mapping_v2": [{"uuid": "17318419-269d-421d-91ca-58193f5c033b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "246c2727-fc8d-41fb-b4a0-57699ab0459c"}]}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:54.642644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] validate_networks() for [('246c2727-fc8d-41fb-b4a0-57699ab0459c', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:10:54.887630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:54.888232 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:54.895771 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:54.896223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:54.897022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:54.897461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:55.040275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:55.050284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:55.051778 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:55.052998 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bd1670c8-0d69-4067-a200-c9f5e6233b12 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.169276 Jul 12 22:10:55.053607 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 316/624] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:54 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:10:55.214906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:10:55.215403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:10:55.215948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:10:55.216427 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:10:55.216948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:10:55.227017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:55.227722 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:55.228795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:55.229240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:55.248653 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:10:55.253228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for user 24a41c09f2e4487f9897c9888a0d752f and project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:10:55.298922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759340885", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afbe5681-6e61-4873-a265-db662a1dd309"}], "security_groups": [{"name": "tempest-securitygroup--1186103060"}], "key_name": "tempest-keypair-1603546043", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:55.312809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:10:55.314946 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17318419-269d-421d-91ca-58193f5c033b',volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:10:55.410852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] validate_networks() for [('afbe5681-6e61-4873-a265-db662a1dd309', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:10:55.456057 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9771a365-a3f2-4ed2-8986-fa712632a179 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982805 Jul 12 22:10:55.457037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 309/625] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:10:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:10:55.467212 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c4f89ae7-409d-43d9-81b2-65c4c82cecce tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:55.467840 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c4f89ae7-409d-43d9-81b2-65c4c82cecce tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:55.527111 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c4f89ae7-409d-43d9-81b2-65c4c82cecce tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:55.536820 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c4f89ae7-409d-43d9-81b2-65c4c82cecce tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1095 microversion: 2.1 time: 0.073334 Jul 12 22:10:55.537584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 310/626] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:55 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:55.826041 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:10:55.826504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:10:55.827047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:10:55.827444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:10:55.828075 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:10:55.837756 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:55.838241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:55.839280 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:55.839783 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:55.859662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:10:55.864082 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Getting quotas for user 85dea53a4a034f5981b638bf92f2cf3b and project 1e4d6faeb79c4834a4ca61193f0cc657. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:10:55.875974 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:10:55.878451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:10:55.925980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-893cf69b-db94-4a31-b345-ea5258ff9546 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688074 Jul 12 22:10:55.931775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 317/627] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:10:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 22:10:55.936730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aba1444b-19a4-47fb-a538-e538e392847c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:55.938116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aba1444b-19a4-47fb-a538-e538e392847c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:56.000815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-aba1444b-19a4-47fb-a538-e538e392847c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:56.008537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aba1444b-19a4-47fb-a538-e538e392847c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1241 microversion: 2.1 time: 0.075737 Jul 12 22:10:56.009482 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 311/628] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:55 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:56.074852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:56.074852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:56.083207 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:56.083670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:56.084463 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:56.084997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:56.224364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:56.233757 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:56.235356 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:56.236528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8f70b879-7b85-4101-9b64-d0c910b75ba1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.168796 Jul 12 22:10:56.237118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 318/629] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:56 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:56.554019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:56.554642 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:56.564179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:56.565365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:56.566714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:56.567138 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:56.634859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:56.643096 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8f1f3223-8625-483b-bfb3-519a08b78dee tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1211 microversion: 2.1 time: 0.092785 Jul 12 22:10:56.643736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 312/630] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:56 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:57.025786 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:57.027088 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:57.029942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:10:57.038618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.039624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.040655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.041287 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.149887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:57.159386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-723c460b-d8c0-4a76-924e-b8bab6a85e56 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1311 microversion: 2.1 time: 0.137216 Jul 12 22:10:57.160342 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 319/631] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:57 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:57.372508 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:57.373172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:57.379733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.380182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.380988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.381425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.663537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:57.664077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:57.673817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.674289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.675132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:57.676328 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:57.757134 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:57.767590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:57.769884 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:57.771186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9fc511b2-fe24-46e3-b618-52fee8ea3909 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.519446 Jul 12 22:10:57.771751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 313/632] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:57 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:58.056251 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:58.067053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3fd1dca4-6f3d-409e-b3b9-2132dec9863e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.410148 Jul 12 22:10:58.067703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 320/633] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:57 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:10:58.177565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:58.178378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:58.184571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:58.185013 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:58.185794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:58.186231 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:58.326063 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:58.335353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0b0af482-746f-4a49-be6f-870635650c4b tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.162068 Jul 12 22:10:58.336223 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 314/634] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:58 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:58.793369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:58.794319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:58.807278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:58.807896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:58.808816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:58.809374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.058579 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:59.068090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:59.070163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:59.071318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02e25471-6e96-4784-a140-62db5450abce tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.284321 Jul 12 22:10:59.072068 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 321/635] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:10:58 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:10:59.084228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:59.084876 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:59.091154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:59.091603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.092381 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:59.092844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.252164 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:59.263177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5599e159-c223-4e10-b986-ad80f3882e22 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.182757 Jul 12 22:10:59.263959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 315/636] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:59 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:10:59.299475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-549dac68-4290-4710-95c6-96e2bbb19745 req-f00452b8-249f-43ce-b4a9-afd64801ef1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3061dbc-2e72-428f-b5d7-12ec63ca924e", "tag": "b6de339e-8d74-49bd-ae6f-60a5b8e0f582"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:10:59.313086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-549dac68-4290-4710-95c6-96e2bbb19745 req-f00452b8-249f-43ce-b4a9-afd64801ef1a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:59.314457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-549dac68-4290-4710-95c6-96e2bbb19745 req-f00452b8-249f-43ce-b4a9-afd64801ef1a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.332383 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-549dac68-4290-4710-95c6-96e2bbb19745 req-f00452b8-249f-43ce-b4a9-afd64801ef1a service nova] Creating event network-changed:b6de339e-8d74-49bd-ae6f-60a5b8e0f582 for instance a3061dbc-2e72-428f-b5d7-12ec63ca924e on hv-cinder-80295 Jul 12 22:10:59.339509 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-549dac68-4290-4710-95c6-96e2bbb19745 req-f00452b8-249f-43ce-b4a9-afd64801ef1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046567 Jul 12 22:10:59.340138 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 322/637] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:10:59.354487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:10:59.355206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:10:59.365425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:59.366865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.367904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:10:59.368555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:10:59.525010 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:10:59.533348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-077d2579-7968-4277-85cc-a5c9e1486873 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.183304 Jul 12 22:10:59.534065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 316/638] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:10:59 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:00.090990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:00.091722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:00.099274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.099999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.100864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.101464 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.280280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:00.280934 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:00.287804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.288248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.289049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.289479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.397752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:00.408436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:00.410655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:00.411929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76423f75-7e3e-4374-9b6c-393ea5c7cf90 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.326007 Jul 12 22:11:00.412573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 323/639] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:00 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:00.445189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:00.452942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-55fbfe49-883a-4c04-8e2a-e2fb850b4c1a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.176359 Jul 12 22:11:00.454040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 317/640] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:00 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:00.551175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:00.551910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:00.558512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.558890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.559688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:00.560146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:00.885593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:00.893204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0fff290e-4ede-4cbb-9b71-de64d93f5fc6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.346574 Jul 12 22:11:00.893798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 324/641] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:00 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:01.355314 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-2f378f12-69e1-4ebd-97a4-2f5248fe9952 req-ce81bb5b-d263-4d7b-aee9-c7fc6cc3d016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512a3928-cf15-4f8e-befe-f4cf8d2b693d", "tag": "2a16791b-1b30-48d6-8621-9032d5f0b0c5"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:01.364149 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2f378f12-69e1-4ebd-97a4-2f5248fe9952 req-ce81bb5b-d263-4d7b-aee9-c7fc6cc3d016 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.364591 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2f378f12-69e1-4ebd-97a4-2f5248fe9952 req-ce81bb5b-d263-4d7b-aee9-c7fc6cc3d016 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.375366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-2f378f12-69e1-4ebd-97a4-2f5248fe9952 req-ce81bb5b-d263-4d7b-aee9-c7fc6cc3d016 service nova] Creating event network-changed:2a16791b-1b30-48d6-8621-9032d5f0b0c5 for instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d on hv-cinder-80295 Jul 12 22:11:01.380342 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-2f378f12-69e1-4ebd-97a4-2f5248fe9952 req-ce81bb5b-d263-4d7b-aee9-c7fc6cc3d016 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028691 Jul 12 22:11:01.380965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 318/642] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:01.430482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:01.431088 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:01.437762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.438211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.438989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.439423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.459432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:01.471777 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:01.472476 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:01.478769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.479209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.479975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.480398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.581204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:01.589536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:01.591046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:01.592206 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b5df7bd6-c092-481d-8b28-6592d45773b5 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.165597 Jul 12 22:11:01.592901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 325/643] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:01 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:11:01.615350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:01.622771 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9991f751-196b-4a61-8c53-c55d619e8c15 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.156121 Jul 12 22:11:01.623331 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 319/644] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:01 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:01.911200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:01.911727 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:01.917768 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.918220 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:01.918986 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:01.919423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:02.241221 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:02.248590 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e5575d36-8ead-47c8-afce-f1157671b9b3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.341706 Jul 12 22:11:02.249197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 326/645] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:01 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:02.612500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:02.613186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:02.620301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:02.620779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:02.621560 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:02.621998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:02.639643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:02.640323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:02.646904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:02.647357 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:02.648137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:02.648579 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:02.763066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:02.772440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:02.773995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:02.775158 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8b7d8b7e-0d3f-4137-907c-9cd33ff034ac tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.167659 Jul 12 22:11:02.775727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 320/646] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:02 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:02.794527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:02.802556 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1081fcc7-3afd-48c9-ba98-1fec5801c4c6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.166696 Jul 12 22:11:02.803115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 327/647] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:02 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:03.266007 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:03.266704 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:03.272854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.273303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.274074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.274513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.417300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:03.425046 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5344161f-886b-49c5-98ae-ec7bfac62b31 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.163499 Jul 12 22:11:03.425624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 321/648] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:03 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:03.794310 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:03.794836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:03.803124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.803673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.804513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.804989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.819588 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:03.820964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:03.826983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.827440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.828735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:03.829305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:03.950538 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:03.967317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:03.969777 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:03.971164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-990f50ef-eda8-4a51-86d1-ae6b5964ed66 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1744 microversion: 2.20 time: 0.180662 Jul 12 22:11:03.971731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 328/649] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:03 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:03.982834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:03.991029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7d15ef95-6197-4cce-8f6a-fac447145502 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.175451 Jul 12 22:11:03.991657 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 322/650] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:03 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:04.442705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:04.443343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:04.449976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:04.450373 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:04.451153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:04.451590 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:04.586765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:04.594853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b03d5657-1d41-4cda-a740-bfb751ad3766 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.156305 Jul 12 22:11:04.595417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 329/651] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:04 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:04.991338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:04.991951 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:05.000339 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.000812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.001600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.002091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.007410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:05.008444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:05.015015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.016120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.017012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.017477 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.165496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:05.166551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:05.174257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c069ec9-c225-4539-8ee7-99fc9ba07720 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.170666 Jul 12 22:11:05.175001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 330/652] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:05 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:05.175815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:05.177355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:05.178508 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-557e1e50-0796-49cc-8b57-bbe56d047d58 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1744 microversion: 2.20 time: 0.192373 Jul 12 22:11:05.179192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 323/653] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:04 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:05.612507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:05.613502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:05.620685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.621168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.621949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:05.622385 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:05.769412 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:05.779042 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1f42819-ba8d-495a-b537-a479aae87f2f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.171105 Jul 12 22:11:05.780363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 331/654] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:05 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:06.052638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:06.055718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=14 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:06.060904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-47b6f719-692e-411c-a852-5b62fb3710a3 req-5403cba7-96f8-4e83-9930-c27ccccbc76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512a3928-cf15-4f8e-befe-f4cf8d2b693d", "name": "network-vif-plugged", "status": "completed", "tag": "2a16791b-1b30-48d6-8621-9032d5f0b0c5"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:06.086811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-47b6f719-692e-411c-a852-5b62fb3710a3 req-5403cba7-96f8-4e83-9930-c27ccccbc76e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.087262 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-47b6f719-692e-411c-a852-5b62fb3710a3 req-5403cba7-96f8-4e83-9930-c27ccccbc76e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.112493 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-47b6f719-692e-411c-a852-5b62fb3710a3 req-5403cba7-96f8-4e83-9930-c27ccccbc76e service nova] Creating event network-vif-plugged:2a16791b-1b30-48d6-8621-9032d5f0b0c5 for instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d on hv-cinder-80295 Jul 12 22:11:06.128005 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-47b6f719-692e-411c-a852-5b62fb3710a3 req-5403cba7-96f8-4e83-9930-c27ccccbc76e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076436 Jul 12 22:11:06.128626 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 324/655] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:06.191728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:06.192362 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:06.201284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:06.201923 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:06.202594 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:06.203582 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:06.209096 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.212395 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.214647 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.217871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.224281 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.225069 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.226620 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.227479 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.487107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:06.496735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:06.498971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:06.501130 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7ccb72fd-78c0-47c0-b206-670b8cb67d6d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.308111 Jul 12 22:11:06.515716 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 325/656] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:06 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 22:11:06.526460 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:06.534693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e6012590-c654-49a0-b479-5af2335d1cb1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.347437 Jul 12 22:11:06.535270 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 332/657] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:06 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:06.798464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:06.799510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:06.807307 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.807989 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.809377 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:06.810096 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:06.967865 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:06.978140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-cb66d254-65c7-42f5-9d06-2fab9fb8cf15 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.183891 Jul 12 22:11:06.979243 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 326/658] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:06 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:07.521640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:07.522250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:07.529580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:07.530313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:07.531842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:07.532507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:07.553693 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:07.555189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:07.557799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:07.564318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:07.565329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:07.566278 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:07.566867 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:07.700829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:07.710332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:07.712233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:07.713507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1b8f134b-14c3-4aba-8c1e-1fc8a9de6c98 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.195819 Jul 12 22:11:07.726211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 333/659] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:07 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:07.766637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:07.782625 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6c335fa0-a83b-4c1d-bbf6-2d1a82925ec6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.233718 Jul 12 22:11:07.783221 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 327/660] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:07 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:07.995554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:07.996531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:08.004624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.004624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.009908 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.010449 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.144162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-6664677a-51e0-4285-8804-2d0f11499b3e req-3f1fd363-a7e9-4eee-bd85-2ff1abc3d548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "name": "network-vif-plugged", "status": "completed", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:08.160794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6664677a-51e0-4285-8804-2d0f11499b3e req-3f1fd363-a7e9-4eee-bd85-2ff1abc3d548 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.163720 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6664677a-51e0-4285-8804-2d0f11499b3e req-3f1fd363-a7e9-4eee-bd85-2ff1abc3d548 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.171874 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:08.194059 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-6664677a-51e0-4285-8804-2d0f11499b3e req-3f1fd363-a7e9-4eee-bd85-2ff1abc3d548 service nova] Creating event network-vif-plugged:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:11:08.200152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-6664677a-51e0-4285-8804-2d0f11499b3e req-3f1fd363-a7e9-4eee-bd85-2ff1abc3d548 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060199 Jul 12 22:11:08.201258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 328/661] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:08.245419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:08.255938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9b24dc0d-40de-4273-8c2f-73aadeed5ec8 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1367 microversion: 2.1 time: 0.264329 Jul 12 22:11:08.256741 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 334/662] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:07 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:08.734902 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:08.736301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:08.744769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.744769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.746033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.746173 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.802738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:08.803969 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:08.814581 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.815021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.816749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:08.816749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:08.901824 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:08.914875 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:08.916740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:08.918144 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-03afdd29-225d-4b34-beb0-e81a96666264 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.188388 Jul 12 22:11:08.919812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 329/663] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:08 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:08.987027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:08.997685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-38379bf9-cd25-4c90-8ed2-37e75ee7d335 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.201592 Jul 12 22:11:08.998267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 335/664] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:08 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:09.273235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:09.273930 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:09.280363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.281178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:09.282084 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.282633 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:09.428140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:09.436569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2bfe6a80-b44c-46b2-a2ea-507421d6cb0c tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1556 microversion: 2.1 time: 0.167143 Jul 12 22:11:09.445531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 330/665] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:09 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:09.454642 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:09.455248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:09.463309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.463769 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:09.464924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.465712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:09.567530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41cb8d68-8ab9-47c5-99b8-f6a5172e3b38 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117467 Jul 12 22:11:09.572590 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 336/666] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:11:09 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:09.939952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:09.940686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:09.949984 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.950514 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:09.951594 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:09.952846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:10.018363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:10.021487 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:10.034027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:10.037274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:10.037274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:10.037274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:10.191451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:10.201681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:10.203791 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:10.205050 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8e86e90d-168a-4ac3-b957-64359e905fa3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.270319 Jul 12 22:11:10.216759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 331/667] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:09 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:10.854530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:10.863426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-066e5554-7464-441a-9231-19a50e2804b4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.852846 Jul 12 22:11:10.873859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 337/668] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:10 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:11.113906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-6055b275-1309-4cdb-9458-5b667e236cc2 req-44816efe-dc93-4a57-975a-60a1aef3518c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512a3928-cf15-4f8e-befe-f4cf8d2b693d", "tag": "2a16791b-1b30-48d6-8621-9032d5f0b0c5"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:11.125115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6055b275-1309-4cdb-9458-5b667e236cc2 req-44816efe-dc93-4a57-975a-60a1aef3518c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:11.125925 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-6055b275-1309-4cdb-9458-5b667e236cc2 req-44816efe-dc93-4a57-975a-60a1aef3518c service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:11.141484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-6055b275-1309-4cdb-9458-5b667e236cc2 req-44816efe-dc93-4a57-975a-60a1aef3518c service nova] Creating event network-changed:2a16791b-1b30-48d6-8621-9032d5f0b0c5 for instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d on hv-cinder-80295 Jul 12 22:11:11.163552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-6055b275-1309-4cdb-9458-5b667e236cc2 req-44816efe-dc93-4a57-975a-60a1aef3518c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053138 Jul 12 22:11:11.164182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 332/669] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:11.228891 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:11.231043 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:11.239916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:11.240497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:11.241444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:11.241978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:11.494093 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:11.509813 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:11.520028 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:11.521521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0e105ae9-9a21-493f-8b9b-b0e99831d040 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.296609 Jul 12 22:11:11.533942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 338/670] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:11 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:11.881478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:11.881736 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:11.899921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:11.900425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:11.901292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:11.901735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:12.126881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-012c7f2a-7971-4904-81ca-959fda0206af req-7e3d41c2-5c9a-4fea-9d9c-5f054f3f37b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3061dbc-2e72-428f-b5d7-12ec63ca924e", "name": "network-vif-plugged", "status": "completed", "tag": "b6de339e-8d74-49bd-ae6f-60a5b8e0f582"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:12.143796 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-012c7f2a-7971-4904-81ca-959fda0206af req-7e3d41c2-5c9a-4fea-9d9c-5f054f3f37b7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:12.144703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-012c7f2a-7971-4904-81ca-959fda0206af req-7e3d41c2-5c9a-4fea-9d9c-5f054f3f37b7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:12.165297 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-012c7f2a-7971-4904-81ca-959fda0206af req-7e3d41c2-5c9a-4fea-9d9c-5f054f3f37b7 service nova] Creating event network-vif-plugged:b6de339e-8d74-49bd-ae6f-60a5b8e0f582 for instance a3061dbc-2e72-428f-b5d7-12ec63ca924e on hv-cinder-80295 Jul 12 22:11:12.180467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-012c7f2a-7971-4904-81ca-959fda0206af req-7e3d41c2-5c9a-4fea-9d9c-5f054f3f37b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058399 Jul 12 22:11:12.184001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 339/671] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:11:12.225432 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:12.234184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e2ed94fb-4392-4dc2-b083-0f0c9a4ea342 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.357259 Jul 12 22:11:12.234814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 333/672] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:11 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:12.543558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:12.545123 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:12.554743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:12.558779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:12.560066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:12.560926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:12.720341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:12.729368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:12.731364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:12.732528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-80582dab-8159-4b09-89c7-0d45bcd55ab1 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.195776 Jul 12 22:11:12.734151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 340/673] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:12 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:13.251252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:13.252616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:13.259943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:13.260536 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:13.261348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:13.261966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:13.419800 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:13.428049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d1c766f9-edc0-44a7-b52c-4aa4b6def1ae tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1267 microversion: 2.1 time: 0.180937 Jul 12 22:11:13.428621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 334/674] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:13 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:13.754167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:13.755613 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:13.762835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:13.763654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:13.764679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:13.765975 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:13.909289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:13.918935 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:13.921009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:13.922192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-90714039-f18d-4160-8763-15716667268f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.172114 Jul 12 22:11:13.922925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 341/675] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:13 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:14.448517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:14.450106 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:14.458659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.459115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:14.459935 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.460729 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:14.606819 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:14.616533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9670e2cf-8e0f-4b3e-91c7-10222a7fa2bf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1454 microversion: 2.1 time: 0.171589 Jul 12 22:11:14.617467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 335/676] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:14 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:14.636649 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:14.637309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:14.646676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.647117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:14.647889 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.648321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:14.797916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:14.806830 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b3cdabe4-c261-4156-a874-8643408e500e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1454 microversion: 2.1 time: 0.173941 Jul 12 22:11:14.807493 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 342/677] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:14 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:14.940453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:14.941109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:14.948114 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.948428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:14.949074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:14.949542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:15.198930 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:15.209261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:15.211071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:15.212455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4a4fc823-72fd-46b6-9047-b116b5dcfbd3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1739 microversion: 2.20 time: 0.276311 Jul 12 22:11:15.213503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 336/678] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:14 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:16.230805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:16.231421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:16.238815 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:16.239268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:16.240036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:16.240446 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:16.244746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:16.379566 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:16.387529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:16.389065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:16.390734 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-98d0668d-5616-44ca-baba-fc7cd8a5290f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1721 microversion: 2.20 time: 0.163766 Jul 12 22:11:16.391290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 343/679] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:16 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:16.596016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-65d4ae59-1292-47e8-890d-61f1df21370e req-caaec581-b57a-48cf-8890-0eb9534adabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3061dbc-2e72-428f-b5d7-12ec63ca924e", "tag": "b6de339e-8d74-49bd-ae6f-60a5b8e0f582"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:16.604734 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-65d4ae59-1292-47e8-890d-61f1df21370e req-caaec581-b57a-48cf-8890-0eb9534adabe service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:16.605185 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-65d4ae59-1292-47e8-890d-61f1df21370e req-caaec581-b57a-48cf-8890-0eb9534adabe service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:16.616991 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-65d4ae59-1292-47e8-890d-61f1df21370e req-caaec581-b57a-48cf-8890-0eb9534adabe service nova] Creating event network-changed:b6de339e-8d74-49bd-ae6f-60a5b8e0f582 for instance a3061dbc-2e72-428f-b5d7-12ec63ca924e on hv-cinder-80295 Jul 12 22:11:16.621852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-65d4ae59-1292-47e8-890d-61f1df21370e req-caaec581-b57a-48cf-8890-0eb9534adabe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030325 Jul 12 22:11:16.622447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 337/680] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:17.409872 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:17.410645 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:17.417637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:17.418077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:17.418842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:17.419272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:17.557470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:17.566780 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:17.568287 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:17.569735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9a896d2f-5bfa-4bd6-99a4-de02e2bf941b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1721 microversion: 2.20 time: 0.164352 Jul 12 22:11:17.570301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 344/681] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:17 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:18.589173 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:18.589871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:18.596177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:18.596629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:18.597422 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:18.597859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:18.729198 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:18.738349 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:18.739878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:18.741092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e104e2f3-56d7-41f7-9551-289f0125d52e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1664 microversion: 2.20 time: 0.156727 Jul 12 22:11:18.741660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 338/682] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:18 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:18.759495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "562ced37-a5b7-44de-b931-f225f0e7e7f0"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:18.760740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:18.767682 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:18.768135 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:18.768979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:18.769468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.202390 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37c4b9dc-d586-413b-b981-7a8903812f96 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.447072 Jul 12 22:11:19.203043 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 345/683] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jul 12 22:11:18 2022] POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments => generated 188 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 22:11:19.316478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:19.317000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:19.323234 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.323678 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.324432 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.324907 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.562369 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-efd46faa-d4f7-4331-9526-fc0a2a749761 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments/562ced37-a5b7-44de-b931-f225f0e7e7f0" status: 202 len: 0 microversion: 2.20 time: 0.249707 Jul 12 22:11:19.563152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 339/684] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jul 12 22:11:19 2022] DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments/562ced37-a5b7-44de-b931-f225f0e7e7f0 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:11:19.618326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:19.618900 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:19.626496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.626945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.627726 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.628170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.706149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-36435122-710d-4920-b006-74c04627b882 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/action" status: 202 len: 0 microversion: 2.20 time: 0.091642 Jul 12 22:11:19.706850 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 346/685] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jul 12 22:11:19 2022] POST /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:11:19.714743 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:19.715357 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:19.723147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.723601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.724372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.724917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.872047 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:19.884670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:19.886406 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:19.889632 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-60d73041-ef6d-40dd-9568-0bd69c5862bc tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1672 microversion: 2.20 time: 0.178768 Jul 12 22:11:19.890199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 340/686] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:19 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:19.926920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5c0e1742-09dc-4b07-beb4-0dda899d522e req-d3dca80c-448c-46ef-b0d7-b5166e8101a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "name": "network-vif-unplugged", "status": "completed", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:19.937087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5c0e1742-09dc-4b07-beb4-0dda899d522e req-d3dca80c-448c-46ef-b0d7-b5166e8101a4 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:19.937758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5c0e1742-09dc-4b07-beb4-0dda899d522e req-d3dca80c-448c-46ef-b0d7-b5166e8101a4 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:19.950115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.compute.server_external_events [req-5c0e1742-09dc-4b07-beb4-0dda899d522e req-d3dca80c-448c-46ef-b0d7-b5166e8101a4 service nova] Unable to find a host for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201. Dropping event network-vif-unplugged {{(pid=117938) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 22:11:19.950979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5c0e1742-09dc-4b07-beb4-0dda899d522e req-d3dca80c-448c-46ef-b0d7-b5166e8101a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028710 Jul 12 22:11:19.951558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 347/687] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 22:11:20.908163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:20.908852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:20.917788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:20.918165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:20.919115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:20.919559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:21.004953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:21.005490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:21.012530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:21.013038 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:21.013821 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:21.014263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:21.077794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:21.086231 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:21.087885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:21.089079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-708648ee-066e-41d1-91a5-ee64a3edda62 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.185403 Jul 12 22:11:21.089651 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 341/688] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:20 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:21.109804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lazy-loading 'services' on Instance uuid 889eb530-e983-41f7-ab72-7fe91972b910 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:11:21.186004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9aec3641-1df6-4df5-a7cd-a09e14319502 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments/54e062db-3bf8-42bd-b2bf-5d186571454a" status: 202 len: 0 microversion: 2.1 time: 0.187137 Jul 12 22:11:21.186826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 348/689] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:11:20 2022] DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments/54e062db-3bf8-42bd-b2bf-5d186571454a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:11:21.198177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:21.199445 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:21.206513 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:21.207240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:21.208523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:21.209159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:21.245636 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d1d24cdc-c5a0-4176-84a1-77c03af46b61 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054304 Jul 12 22:11:21.246221 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 342/690] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:11:21 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:22.109527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:22.110336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:22.117829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.118129 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.118972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.119409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.259645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:22.261545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:22.278333 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.280034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.283182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.284088 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.323931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:22.332902 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:22.341881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:22.344242 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2116b39b-caec-4884-baf7-2d032afb6969 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.238372 Jul 12 22:11:22.345080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 349/691] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:22 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:22.355295 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f4582eb1-8ea9-4744-8cd7-cdc5a2ad0b56 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100336 Jul 12 22:11:22.355964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 343/692] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:11:22 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 22:11:22.439829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:22.440409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:22.447064 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.447637 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.448503 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.449116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.478319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:11:22.581677 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68c4de7c-899d-4276-9aff-4117bc26add8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 204 len: 0 microversion: 2.1 time: 0.145870 Jul 12 22:11:22.582667 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 350/693] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:11:22 2022] DELETE /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:11:22.590341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:22.591088 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:22.597890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.598348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.599135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:22.599579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:22.603905 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:22.743336 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:22.751841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3e57e2fd-8383-4d63-9e1d-c89b3ba5cf29 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.165358 Jul 12 22:11:22.752395 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 344/694] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:22 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:23.364611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:23.365513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:23.372067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:23.372506 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:23.373304 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:23.373749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:23.517170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:23.525419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:23.526939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:23.528094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-afa5d659-9a78-4a53-b4ac-4b9d05dccd30 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.167781 Jul 12 22:11:23.528781 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 351/695] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:23 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:23.769584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:23.770312 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:23.776788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:23.777235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:23.777991 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:23.778453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:23.921036 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:23.930113 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fa42fdcc-3824-417b-ac11-8f9cfaaaffac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.165507 Jul 12 22:11:23.930754 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 345/696] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:23 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:24.548180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:24.548913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:24.555584 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:24.556041 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:24.556901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:24.557338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:24.692330 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:24.701389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:24.703349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:24.704095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ce9905bd-237d-4b2d-9a60-2b5702b26924 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.160304 Jul 12 22:11:24.704664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 352/697] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:24 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:24.948049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:24.948593 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:24.956157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:24.956601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:24.958347 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:24.958955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:25.120331 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:25.128538 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ebf19566-87ba-4bc6-8dc0-523b213727d8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.184817 Jul 12 22:11:25.129159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 346/698] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:24 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:25.723168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:25.723768 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:25.730622 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:25.731168 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:25.732196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:25.732885 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:25.881994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:25.891879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:25.893409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:25.894574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dcbe5065-b0f0-4c03-b23b-94ecb5b62b79 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.175594 Jul 12 22:11:25.895126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 353/699] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:25 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:26.145255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:26.145889 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:26.153460 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:26.153955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:26.154746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:26.155188 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:26.297350 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:26.306217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aaa55921-3ffe-4f29-8bee-c932a9aab1c1 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.164898 Jul 12 22:11:26.306813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 347/700] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:26 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:26.913313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:26.914690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:26.922124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:26.922563 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:26.923631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:26.923983 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:26.944890 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:27.078644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:27.087395 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:27.089003 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:27.090181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91c4c7b7-a47d-47e0-b9f6-8069360307ed tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.180842 Jul 12 22:11:27.097513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 354/701] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:26 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:27.323798 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:27.324509 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:27.332804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:27.333373 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:27.334220 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:27.334583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:27.474897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:27.482577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e277237e-ec2d-44fb-8016-b6b475dd44c9 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.162684 Jul 12 22:11:27.483170 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 348/702] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:27 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:28.110183 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:28.110999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:28.113755 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:28.119270 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:28.119732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:28.120517 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:28.121626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:28.273113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:28.282541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:28.284080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:28.285317 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e534bd80-249f-4e6c-8f0b-2e2e161ae4c2 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.179792 Jul 12 22:11:28.285881 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 355/703] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:28 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:28.499890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:28.500677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:28.507537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:28.507992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:28.508795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:28.509236 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:28.646894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:28.654480 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-544af792-eb4f-4c3f-8873-35eca2cc9871 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.158797 Jul 12 22:11:28.658908 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 349/704] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:28 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:29.303355 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:29.304052 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:29.310539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:29.310978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:29.312601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:29.313063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:29.455402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:29.463589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:29.465121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:29.466285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bcfd6c23-7cb8-491e-b0d7-afa434abcacb tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.166869 Jul 12 22:11:29.466850 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 356/705] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:29 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:29.672366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:29.673079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:29.679606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:29.680054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:29.680861 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:29.681291 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:29.822856 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:29.831755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7f883071-2c96-473f-ba03-7e3e86a15e5e tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.163987 Jul 12 22:11:29.832554 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 350/706] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:29 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:30.486196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:30.486812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:30.494001 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:30.494450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:30.495220 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:30.495656 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:30.643915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:30.652278 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:30.654413 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:30.656019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e515a3bf-125a-45e6-84b5-a920d7c6e315 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.174320 Jul 12 22:11:30.656794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 357/707] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:30 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:30.849822 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:30.850568 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:30.857730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:30.858823 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:30.859753 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:30.860254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:31.000446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:31.008230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1c25217a-ecc8-4b2a-9d23-e375e24c83fd tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.162493 Jul 12 22:11:31.008828 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 351/708] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:30 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:31.674579 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:31.675294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:31.681644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:31.682092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:31.682848 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:31.683281 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:31.820170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:31.828766 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:31.830274 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:31.831429 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ea7797f-e02e-4590-8d73-ec921154db0d tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.160752 Jul 12 22:11:31.832009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 358/709] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:31 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:32.025447 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:32.026390 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:32.033285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:32.033733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:32.034505 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:32.034942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:32.165608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:32.174398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f5d5a968-25d8-403c-ab47-61d4fbb57efe tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.152671 Jul 12 22:11:32.175256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 352/710] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:32 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:32.849675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:32.850279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:32.856845 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:32.857296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:32.858578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:32.859293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:32.993130 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:33.001982 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:33.003498 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:33.004660 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dd564207-c366-484c-ad05-0a5c3958701e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.158897 Jul 12 22:11:33.005248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 359/711] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:32 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:33.191496 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:33.192161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:33.199056 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:33.199502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:33.200264 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:33.200697 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:33.337948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:33.347227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c3ef97c7-e051-49bb-97fe-76e1ef66989f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.159646 Jul 12 22:11:33.347805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 353/712] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:33 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:34.023098 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:34.023743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:34.030508 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:34.030958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:34.031733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:34.032177 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:34.165167 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:34.173257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:34.174764 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:34.175946 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d59f46a5-a976-4c8f-9c4a-776e19e2584e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.156792 Jul 12 22:11:34.176502 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 360/713] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:34 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:34.364358 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:34.365017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:34.371276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:34.371760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:34.372565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:34.373038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:34.510049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:34.517794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7b55f07f-e4f9-4772-9318-a13bf75e1fb7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.157582 Jul 12 22:11:34.518363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 354/714] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:34 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:35.195388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:35.195941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:35.203095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:35.203534 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:35.204284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:35.204786 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:35.336735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:35.345249 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:35.346762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:35.347920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08738b52-ce1c-4bea-9941-8cac3e19d7bd tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.156869 Jul 12 22:11:35.348476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 361/715] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:35 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:35.535346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:35.535955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:35.542597 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:35.543046 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:35.543808 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:35.544245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:35.677204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:35.684660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-84504a65-a481-44dc-a3f8-fe1e1d954646 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1688 microversion: 2.1 time: 0.153274 Jul 12 22:11:35.685249 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 355/716] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:35 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:36.114591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-66e2140f-a765-414b-a4f4-1817b57cc6c1 req-77d81367-fc04-43cf-96c5-8c9f35325ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "name": "network-vif-plugged", "status": "completed", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:36.130050 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-66e2140f-a765-414b-a4f4-1817b57cc6c1 req-77d81367-fc04-43cf-96c5-8c9f35325ebf service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:36.130593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-66e2140f-a765-414b-a4f4-1817b57cc6c1 req-77d81367-fc04-43cf-96c5-8c9f35325ebf service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:36.142968 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-66e2140f-a765-414b-a4f4-1817b57cc6c1 req-77d81367-fc04-43cf-96c5-8c9f35325ebf service nova] Creating event network-vif-plugged:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:11:36.149286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-66e2140f-a765-414b-a4f4-1817b57cc6c1 req-77d81367-fc04-43cf-96c5-8c9f35325ebf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106440 Jul 12 22:11:36.149954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 362/717] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:36.366972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:36.367538 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:36.374409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:36.375235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:36.376616 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:36.377102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:36.511989 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:36.521441 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:36.523099 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:36.524377 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b77cc868-c83d-43fa-8a13-7be69f28cdb3 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.161676 Jul 12 22:11:36.525092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 356/718] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:36 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:36.704728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:36.705796 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:36.712438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:36.713069 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:36.713946 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:36.714475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:36.818248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:36.826021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-10e92699-ccfa-4b33-b87f-394a99d9c247 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 200 len: 1621 microversion: 2.1 time: 0.127570 Jul 12 22:11:36.826600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 363/719] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:36 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 1621 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:36.994329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-f0241fa4-1f61-4c05-9d7a-6941f0130866 req-d84478b8-9a67-4174-83f0-b50bd7c8be36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889eb530-e983-41f7-ab72-7fe91972b910", "name": "network-vif-deleted", "tag": "92e3796b-c86a-4386-834b-3ba0408a1593"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:37.005159 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-f0241fa4-1f61-4c05-9d7a-6941f0130866 req-d84478b8-9a67-4174-83f0-b50bd7c8be36 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:37.005605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-f0241fa4-1f61-4c05-9d7a-6941f0130866 req-d84478b8-9a67-4174-83f0-b50bd7c8be36 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:37.019937 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-f0241fa4-1f61-4c05-9d7a-6941f0130866 req-d84478b8-9a67-4174-83f0-b50bd7c8be36 service nova] Creating event network-vif-deleted:92e3796b-c86a-4386-834b-3ba0408a1593 for instance 889eb530-e983-41f7-ab72-7fe91972b910 on hv-cinder-80295 Jul 12 22:11:37.025414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-f0241fa4-1f61-4c05-9d7a-6941f0130866 req-d84478b8-9a67-4174-83f0-b50bd7c8be36 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093524 Jul 12 22:11:37.027359 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 357/720] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:37.543567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:37.544197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:37.551118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:37.551644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:37.552483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:37.553023 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:37.692298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:37.700296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:37.702665 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:37.704000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e03348ad-bcad-49f2-91f9-5511000e46ad tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.164405 Jul 12 22:11:37.704573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 364/721] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:37 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:37.844809 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:37.845901 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 889eb530-e983-41f7-ab72-7fe91972b910] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:37.850068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=62 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:37.855877 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:37.856327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:37.857133 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:37.857563 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:37.871872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] HTTP exception thrown: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Request method failure captured: Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 HTTP/1.1 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfCK0jfkpFCo0W6TnU05hdYQxZM7YI7muJvb-_ONZhNuPMLjq3Ys9cAdmVMpXLD4vg-FL5NwJpWRdPQ1pl0nPDNOUphy4xPxbVAzUHbpk6_eeU2x11Vaql5Bmq4KFZQQfm1BlsvnkTDudJrcMuRj2gf2Mc-oh9mHZoWNNiB2I946mEs Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:11:37.873646 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b4f6be5087f4fd18a60969372480425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 309de655c8d64223a9c2d75ff5618411 Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. Jul 12 22:11:37.875955 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '889eb530-e983-41f7-ab72-7fe91972b910'} Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:11:37.876899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. Jul 12 22:11:37.878204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:11:37.879392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Returning 404 to user: Instance 889eb530-e983-41f7-ab72-7fe91972b910 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:11:37.879392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ac2bc4bd-0427-4e29-ba59-0527142612ac tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910" status: 404 len: 111 microversion: 2.1 time: 0.035698 Jul 12 22:11:37.879392 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 358/722] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:37 2022] GET /compute/v2.1/servers/889eb530-e983-41f7-ab72-7fe91972b910 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:11:37.888174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-074d7603-5f87-4ff2-9fc1-181cc2b67df7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '.version_select at 0x7f1b6aa85f70>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:37.907450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-074d7603-5f87-4ff2-9fc1-181cc2b67df7 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185680446" status: 202 len: 0 microversion: 2.1 time: 0.023114 Jul 12 22:11:37.908216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 365/723] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jul 12 22:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185680446 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:11:38.723750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:38.724353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:38.732863 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:38.733961 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:38.735094 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:38.735361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:38.951334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:38.960200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:38.962679 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:38.964150 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b0a0e6a3-457c-4903-8f47-47bf92275932 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1730 microversion: 2.20 time: 0.244415 Jul 12 22:11:38.964704 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 359/724] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:38 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:39.983403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:39.984094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:39.990721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:39.991175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:39.991937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:39.992368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:40.139484 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:40.148949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:40.150461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:40.151609 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a23d0d88-133b-401e-b062-e4286f973b7a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1717 microversion: 2.20 time: 0.172837 Jul 12 22:11:40.152151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 366/725] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:11:39 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:11:41.179810 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:41.180326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:41.187255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:41.187697 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:41.188455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:41.189012 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:41.215113 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:11:41.258986 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:41.291038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e8bbdb5f-580e-450c-bbbc-85e8003d79d3 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 204 len: 0 microversion: 2.1 time: 0.114709 Jul 12 22:11:41.291629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 360/726] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:11:41 2022] DELETE /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 22:11:41.301521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:41.302227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:41.308879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:41.309335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:41.310104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:41.310548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:41.446694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:41.454786 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-23daf2cd-c91a-4b8c-a364-180bc02fc717 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1508 microversion: 2.1 time: 0.158713 Jul 12 22:11:41.455338 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 367/727] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:41 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:42.473745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:42.474438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:42.480960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:42.481415 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:42.482177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:42.482613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:42.611494 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:42.618952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-57dee088-0b88-4883-9a45-de90f53f4629 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1508 microversion: 2.1 time: 0.149822 Jul 12 22:11:42.619519 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 361/728] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:42 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:43.635734 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:43.636350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:43.643208 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:43.643659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:43.644420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:43.644898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:43.853043 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:43.860428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3c97b8ae-3095-41c6-88cf-efbb8d70e230 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 200 len: 1508 microversion: 2.1 time: 0.228531 Jul 12 22:11:43.861035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 368/729] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:43 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:44.231535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-95c2cbdf-1c11-4bc2-b4e7-149b0d217d63 req-5c0af656-e155-4dab-8f10-32bed9f01800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca7f2f6-f0de-44d2-9f95-a04ba894bc66", "name": "network-vif-deleted", "tag": "91661900-db83-420e-9017-4dd79576f7e7"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:44.246311 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-95c2cbdf-1c11-4bc2-b4e7-149b0d217d63 req-5c0af656-e155-4dab-8f10-32bed9f01800 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:44.246854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-95c2cbdf-1c11-4bc2-b4e7-149b0d217d63 req-5c0af656-e155-4dab-8f10-32bed9f01800 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:44.262859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-95c2cbdf-1c11-4bc2-b4e7-149b0d217d63 req-5c0af656-e155-4dab-8f10-32bed9f01800 service nova] Creating event network-vif-deleted:91661900-db83-420e-9017-4dd79576f7e7 for instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 on hv-cinder-80295 Jul 12 22:11:44.268114 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-95c2cbdf-1c11-4bc2-b4e7-149b0d217d63 req-5c0af656-e155-4dab-8f10-32bed9f01800 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044051 Jul 12 22:11:44.268785 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 362/730] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:44.877817 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:44.878371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:44.885174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:44.885623 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:44.886399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:44.886840 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:44.900904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] HTTP exception thrown: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Request method failure captured: Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 HTTP/1.1 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfCK0jfkpFCo0W6TnU05hdYQxZM7YI7muJvb-_ONZhNuPMLjq3Ys9cAdmVMpXLD4vg-FL5NwJpWRdPQ1pl0nPDNOUphy4xPxbVAzUHbpk6_eeU2x11Vaql5Bmq4KFZQQfm1BlsvnkTDudJrcMuRj2gf2Mc-oh9mHZoWNNiB2I946mEs Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:11:44.902539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b4f6be5087f4fd18a60969372480425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 309de655c8d64223a9c2d75ff5618411 Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. Jul 12 22:11:44.904105 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '7ca7f2f6-f0de-44d2-9f95-a04ba894bc66'} Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:11:44.905767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. Jul 12 22:11:44.907192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:44.908392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Returning 404 to user: Instance 7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:11:44.908392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b20d8b47-7e5f-485b-a14d-c165b22899ce tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66" status: 404 len: 111 microversion: 2.1 time: 0.030153 Jul 12 22:11:44.908392 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 369/731] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:44 2022] GET /compute/v2.1/servers/7ca7f2f6-f0de-44d2-9f95-a04ba894bc66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:11:44.913844 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:44.914423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:44.920904 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:44.921368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:44.922129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:44.922561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:44.946924 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:11:45.022859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a84cfc47-1343-453c-b44c-a9021c0fbe59 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "DELETE /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 204 len: 0 microversion: 2.1 time: 0.112947 Jul 12 22:11:45.023733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 363/732] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:11:44 2022] DELETE /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:11:45.032141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:45.032776 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:45.038845 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:45.039289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:45.040047 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:45.040480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:45.171839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:45.179542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b6c8419e-0d36-4aa1-8528-fcef8c4a6cb8 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.151895 Jul 12 22:11:45.180099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 370/733] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:45 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:46.197911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:46.198628 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:46.205092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:46.205536 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:46.206299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:46.206723 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:46.339755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:46.349737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-12c6d207-1918-4eef-abb5-c2fdb49f679f tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.156318 Jul 12 22:11:46.350325 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 364/734] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:46 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:47.367121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:47.367803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:47.375724 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:47.376170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:47.376976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:47.377410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:47.513505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:47.521614 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-56b619f1-1374-4283-b7ee-285325ea7712 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.158486 Jul 12 22:11:47.522194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 371/735] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:47 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:47.590567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:47.591162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:47.598958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:47.599456 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:47.600349 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:47.600877 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:47.629094 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-286d7acc-0b3b-4cf6-b93e-70f680a6289d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/ips" status: 200 len: 149 microversion: 2.1 time: 0.042567 Jul 12 22:11:47.629595 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 365/736] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:11:47 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:48.538063 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:48.538673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:48.545100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:48.545548 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:48.546543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:48.547136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:48.782694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309de655c8d64223a9c2d75ff5618411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4f6be5087f4fd18a60969372480425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:48.793090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e4be1943-6a80-486b-ba53-21d31ec9a850 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 200 len: 1522 microversion: 2.1 time: 0.258674 Jul 12 22:11:48.793960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 372/737] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:48 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:11:48.969759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5245b12a-5ebd-4e46-a6f3-7e20f670c5bc"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:48.970889 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:48.977285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:48.977728 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:48.978491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:48.978921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:49.089456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b60322cc-d50d-429f-a929-b6ccdaf82332 req-06e9fafc-8f5f-4394-9ef3-498cc358bd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f13d7c-c02d-4b72-90d6-8f7703ffd21c", "name": "network-vif-deleted", "tag": "24b248d6-9626-4883-9d64-eb804e2a6c97"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:11:49.098398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b60322cc-d50d-429f-a929-b6ccdaf82332 req-06e9fafc-8f5f-4394-9ef3-498cc358bd7b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:49.098891 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b60322cc-d50d-429f-a929-b6ccdaf82332 req-06e9fafc-8f5f-4394-9ef3-498cc358bd7b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:49.111523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b60322cc-d50d-429f-a929-b6ccdaf82332 req-06e9fafc-8f5f-4394-9ef3-498cc358bd7b service nova] Creating event network-vif-deleted:24b248d6-9626-4883-9d64-eb804e2a6c97 for instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c on hv-cinder-80295 Jul 12 22:11:49.117432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b60322cc-d50d-429f-a929-b6ccdaf82332 req-06e9fafc-8f5f-4394-9ef3-498cc358bd7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Jul 12 22:11:49.118037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 373/738] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:11:49.247061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2e0529c1-c1df-4c8b-a810-5785936fa3eb tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "POST /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281539 Jul 12 22:11:49.247683 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 366/739] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:11:48 2022] POST /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:49.812635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:49.813263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] [instance: 64f13d7c-c02d-4b72-90d6-8f7703ffd21c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:49.819669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:49.820110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:49.820897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:49.821332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:49.825591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:49.836472 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] HTTP exception thrown: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Request method failure captured: Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c HTTP/1.1 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfCK0jfkpFCo0W6TnU05hdYQxZM7YI7muJvb-_ONZhNuPMLjq3Ys9cAdmVMpXLD4vg-FL5NwJpWRdPQ1pl0nPDNOUphy4xPxbVAzUHbpk6_eeU2x11Vaql5Bmq4KFZQQfm1BlsvnkTDudJrcMuRj2gf2Mc-oh9mHZoWNNiB2I946mEs Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:11:49.838147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b4f6be5087f4fd18a60969372480425"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b4f6be5087f4fd18a60969372480425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4b4f6be5087f4fd18a60969372480425 Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944694420 Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 309de655c8d64223a9c2d75ff5618411 Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944694420-project Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. Jul 12 22:11:49.839731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '64f13d7c-c02d-4b72-90d6-8f7703ffd21c'} Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:11:49.840546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. Jul 12 22:11:49.841999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:11:49.843489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] Returning 404 to user: Instance 64f13d7c-c02d-4b72-90d6-8f7703ffd21c could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:11:49.843489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ba482c42-307e-452f-8b3e-67dddabafa39 tempest-ServerRescueNegativeTestJSON-1944694420 tempest-ServerRescueNegativeTestJSON-1944694420-project] 10.222.0.44 "GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c" status: 404 len: 111 microversion: 2.1 time: 0.032486 Jul 12 22:11:49.843489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 374/740] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:49 2022] GET /compute/v2.1/servers/64f13d7c-c02d-4b72-90d6-8f7703ffd21c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:11:56.878754 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:56.879364 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:56.887407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:56.887855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:56.888929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:56.889360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:56.975842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lazy-loading 'services' on Instance uuid 512a3928-cf15-4f8e-befe-f4cf8d2b693d {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:11:57.050487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c2615d65-ec95-4ccf-bb83-7aa580753290 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments/5245b12a-5ebd-4e46-a6f3-7e20f670c5bc" status: 202 len: 0 microversion: 2.1 time: 0.177490 Jul 12 22:11:57.051085 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 367/741] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:11:56 2022] DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments/5245b12a-5ebd-4e46-a6f3-7e20f670c5bc => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:11:57.059549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:57.062191 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:57.069554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:57.070142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:57.070765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:57.071482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:57.103505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e3fbcacd-fa11-4164-bd74-d2f9151beb2d tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048040 Jul 12 22:11:57.104084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 375/742] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:11:57 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:11:58.117784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:58.119047 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:58.126445 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.126979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.127828 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.128476 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.160115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5fc0ab3b-8e90-411a-84bb-ff45dd71a798 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048203 Jul 12 22:11:58.165802 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 368/743] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:11:58 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:11:58.220874 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:58.221461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:58.223779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:11:58.230016 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.230464 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.231235 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.231661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.267072 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:11:58.356551 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91e14d97-ca7a-4aa4-8f5e-25d58b0133f6 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 204 len: 0 microversion: 2.1 time: 0.138821 Jul 12 22:11:58.357988 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 376/744] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:11:58 2022] DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 22:11:58.366146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:58.366759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:58.372724 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.373872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.374827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:58.375304 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:58.506532 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:58.514079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9baae480-9d6f-415e-a8b7-1e5230f93663 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1681 microversion: 2.1 time: 0.151758 Jul 12 22:11:58.514653 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 369/745] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:58 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:11:59.532621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:11:59.533319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:11:59.539802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:59.540255 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:59.541095 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:11:59.541531 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:11:59.692807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:11:59.700641 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f46d5228-6eee-4c78-8302-0198c2d28060 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1681 microversion: 2.1 time: 0.173025 Jul 12 22:11:59.701652 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 377/746] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:11:59 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:00.718604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:00.719593 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:00.727149 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:00.727712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:00.730590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:00.730590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:00.749133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a1e91665-f3c6-465c-887b-184fab98bc04 req-2dc22485-b40b-43b5-bae1-3e110baa7315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512a3928-cf15-4f8e-befe-f4cf8d2b693d", "name": "network-vif-deleted", "tag": "2a16791b-1b30-48d6-8621-9032d5f0b0c5"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:00.764455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a1e91665-f3c6-465c-887b-184fab98bc04 req-2dc22485-b40b-43b5-bae1-3e110baa7315 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:00.767170 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a1e91665-f3c6-465c-887b-184fab98bc04 req-2dc22485-b40b-43b5-bae1-3e110baa7315 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:00.802250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a1e91665-f3c6-465c-887b-184fab98bc04 req-2dc22485-b40b-43b5-bae1-3e110baa7315 service nova] Creating event network-vif-deleted:2a16791b-1b30-48d6-8621-9032d5f0b0c5 for instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d on hv-cinder-80295 Jul 12 22:12:00.814752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-a1e91665-f3c6-465c-887b-184fab98bc04 req-2dc22485-b40b-43b5-bae1-3e110baa7315 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069636 Jul 12 22:12:00.821051 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 378/747] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:00.860587 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85dea53a4a034f5981b638bf92f2cf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4d6faeb79c4834a4ca61193f0cc657', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:00.868962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-832c28eb-e9cb-4993-b5b1-6d35d15bee5a tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 200 len: 1613 microversion: 2.1 time: 0.154205 Jul 12 22:12:00.869841 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 370/748] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:00 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 1613 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:01.889494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:01.890315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:01.896965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:01.897419 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:01.898187 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:01.898628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:01.913721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d HTTP/1.1 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:01.915450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:01.917099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '512a3928-cf15-4f8e-befe-f4cf8d2b693d'} Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:01.917964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:01.919447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:01.920950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:01.920950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aea42e0b-944e-49f3-a5a7-cde1ec124c22 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 404 len: 111 microversion: 2.1 time: 0.033076 Jul 12 22:12:01.920950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 379/749] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:01 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:01.927012 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ba35b86a-d0c6-462f-bf0b-788f043d33d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '.version_select at 0x7f1b668bfe50>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:01.946322 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ba35b86a-d0c6-462f-bf0b-788f043d33d1 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603546043" status: 202 len: 0 microversion: 2.1 time: 0.023763 Jul 12 22:12:01.946920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 371/750] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jul 12 22:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603546043 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:12:04.748441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:04.749159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:04.755521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:04.755997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:04.756862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:04.757300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:04.772823 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d HTTP/1.1 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:04.774384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.775670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '512a3928-cf15-4f8e-befe-f4cf8d2b693d'} Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:04.776410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.778018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.780621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:04.780621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8018fe60-9fd0-45e6-b689-6f4993fdbd1f tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 404 len: 111 microversion: 2.1 time: 0.032124 Jul 12 22:12:04.780621 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 380/751] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:12:04 2022] DELETE /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:04.785006 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:04.785878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 512a3928-cf15-4f8e-befe-f4cf8d2b693d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:04.795158 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:04.796050 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:04.797328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:04.798073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:04.814713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d HTTP/1.1 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:04.816502 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.818077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '512a3928-cf15-4f8e-befe-f4cf8d2b693d'} Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:04.819280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. Jul 12 22:12:04.820774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:04.822674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 512a3928-cf15-4f8e-befe-f4cf8d2b693d could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:04.822674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1839d06a-4ad6-41b3-adb6-995461d50738 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d" status: 404 len: 111 microversion: 2.1 time: 0.037494 Jul 12 22:12:04.822674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 372/752] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:04 2022] GET /compute/v2.1/servers/512a3928-cf15-4f8e-befe-f4cf8d2b693d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:05.971400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:05.971901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:05.978685 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:05.979139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:05.979910 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:05.980425 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:05.994612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 HTTP/1.1 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:05.996153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:05.997748 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'ce69e77a-f36b-4fcf-ba67-123c5e93f0e8'} Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:05.998710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.000483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.002034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:06.002034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-39ac8449-25a3-47ad-bd25-e788ef4537e9 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 404 len: 111 microversion: 2.1 time: 0.030940 Jul 12 22:12:06.002034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 381/753] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:12:05 2022] DELETE /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:12:06.007401 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:06.008146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: ce69e77a-f36b-4fcf-ba67-123c5e93f0e8] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:06.015895 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.016464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.017344 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.017854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.036193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 HTTP/1.1 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:06.037933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.039218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'ce69e77a-f36b-4fcf-ba67-123c5e93f0e8'} Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:06.039966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. Jul 12 22:12:06.041242 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.042328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:06.042328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f7d85f35-e333-4547-9565-14291ae31791 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8" status: 404 len: 111 microversion: 2.1 time: 0.036334 Jul 12 22:12:06.042328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 373/754] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:06 2022] GET /compute/v2.1/servers/ce69e77a-f36b-4fcf-ba67-123c5e93f0e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:06.048230 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:06.049399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:06.055847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.056302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.057104 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.057551 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.071936 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d HTTP/1.1 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:06.073732 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.075325 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '654e05e7-6f82-4f9c-bc97-dbd95f40ea4d'} Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:06.076812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.078216 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.079704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:06.079704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37b94396-b58e-448a-a18f-491995e273f3 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 404 len: 111 microversion: 2.1 time: 0.030846 Jul 12 22:12:06.079704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 382/755] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:12:06 2022] DELETE /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:12:06.085701 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:06.086315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:06.093475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.093926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.094712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:06.095187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:06.109165 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d HTTP/1.1 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:06.110765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.112318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '654e05e7-6f82-4f9c-bc97-dbd95f40ea4d'} Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:06.113142 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. Jul 12 22:12:06.114687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:06.115992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance 654e05e7-6f82-4f9c-bc97-dbd95f40ea4d could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:06.115992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3f4cd4ee-ef5b-4e25-b446-b9278d21c3c5 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d" status: 404 len: 111 microversion: 2.1 time: 0.031385 Jul 12 22:12:06.115992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 374/756] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:06 2022] GET /compute/v2.1/servers/654e05e7-6f82-4f9c-bc97-dbd95f40ea4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:07.254549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:07.255045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:07.261638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:07.262090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:07.262854 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:07.263451 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:07.276740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c HTTP/1.1 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:07.278290 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.280143 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'acbee16d-55b1-4121-8fe2-023909bbef7c'} Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:07.283901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.285349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.286760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:07.286760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-675f4aa3-81d7-4897-8226-0931f2ee0a43 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 404 len: 111 microversion: 2.1 time: 0.029021 Jul 12 22:12:07.286760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 383/757] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:12:07 2022] DELETE /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:07.289302 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:07.289917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] [instance: acbee16d-55b1-4121-8fe2-023909bbef7c] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:07.297107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:07.297555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:07.298317 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:07.298755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:07.317079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] HTTP exception thrown: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Request method failure captured: Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c HTTP/1.1 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBCnvIYB2wFNkvtB8mOpV12Xc_SZMUroUFbmAS1cL7gxQd0fQ72ImnqCEIG2u1MSg2NuJNikoAjlBdBsQ6kHUtuPltUFm1OVnJgYgfxmayRu_Q6FUvrzjQaB3vChJx6R7xFjO9Ur4vjIjT9iBeChQrXoww6ydvVx_c7LOEOQDH7Pnw Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:07.319635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1e4d6faeb79c4834a4ca61193f0cc657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 1e4d6faeb79c4834a4ca61193f0cc657 Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-985284129 Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 85dea53a4a034f5981b638bf92f2cf3b Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeNegativeTest-985284129-project Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.321838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'acbee16d-55b1-4121-8fe2-023909bbef7c'} Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:07.322649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. Jul 12 22:12:07.323816 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:07.326629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] Returning 404 to user: Instance acbee16d-55b1-4121-8fe2-023909bbef7c could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:07.326629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-26b147c6-8c6a-4f78-bbe0-c156eb081289 tempest-AttachVolumeNegativeTest-985284129 tempest-AttachVolumeNegativeTest-985284129-project] 10.222.0.44 "GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c" status: 404 len: 111 microversion: 2.1 time: 0.035794 Jul 12 22:12:07.326629 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 375/758] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:07 2022] GET /compute/v2.1/servers/acbee16d-55b1-4121-8fe2-023909bbef7c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:12.464993 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f043483f-13d9-4f5b-838b-88c5f90a823f tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Action: 'create', calling method: .version_select at 0x7f1b6a952940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1629947048"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:12.767194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f043483f-13d9-4f5b-838b-88c5f90a823f tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.554326 Jul 12 22:12:12.767953 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 384/759] 10.222.0.44 () {60 vars in 1154 bytes} [Tue Jul 12 22:12:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 556 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 22:12:12.781105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4f20f377-d5b8-4252-a07e-186b213c0f4e tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6695d4c0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:12.838732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4f20f377-d5b8-4252-a07e-186b213c0f4e tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 200 len: 345 microversion: 2.1 time: 0.063045 Jul 12 22:12:12.839302 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 376/760] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:12:12 2022] GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:12.886604 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:12.887515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:12.895561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:12.896004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:12.896805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:12.897241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:12.928318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e6082937-ce0b-4d54-abca-1495a1b7db25 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045572 Jul 12 22:12:12.928980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 385/761] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jul 12 22:12:12 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:12.988434 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:12.989003 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:12.991000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:12.998067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:12.998523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:12.999307 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:12.999752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:13.003122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:13.030993 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:12:13.119536 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5991c46e-0644-4199-a6d7-6cfa9925eb6f tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 204 len: 0 microversion: 2.20 time: 0.134640 Jul 12 22:12:13.120261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 377/762] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jul 12 22:12:12 2022] DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 22:12:13.129227 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:13.129963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:13.136510 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:13.137018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:13.137892 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:13.138635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:13.291110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:13.299523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:13.301048 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:13.302200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-315614f5-11f8-4a51-a406-bd217e5a228a tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.176998 Jul 12 22:12:13.302737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 386/763] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:13 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:12:13.859763 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ff0e1ac8-c32f-431a-8d10-38047f21d81f tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6690fa60>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:13.905417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ff0e1ac8-c32f-431a-8d10-38047f21d81f tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 200 len: 346 microversion: 2.1 time: 0.057633 Jul 12 22:12:13.906194 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 378/764] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:12:13 2022] GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:13.918159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a112218e-8868-4e53-b31c-ea1afd10da91 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Action: 'create', calling method: .version_select at 0x7f1b6a95e280>, body: {"snapshot": {"volume_id": "a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-925595668"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:14.074454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a112218e-8868-4e53-b31c-ea1afd10da91 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160630 Jul 12 22:12:14.075116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 387/765] 10.222.0.44 () {60 vars in 1161 bytes} [Tue Jul 12 22:12:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:12:14.085613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e31ea7ed-4d42-413c-851b-13d8e19a560a tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b66c86430>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:14.120319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e31ea7ed-4d42-413c-851b-13d8e19a560a tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 286 microversion: 2.1 time: 0.038535 Jul 12 22:12:14.120940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 379/766] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:14 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:14.133151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fd914e6a-d5df-4a19-a7f0-b86cddb31753 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6aa85940>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:14.164517 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fd914e6a-d5df-4a19-a7f0-b86cddb31753 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035543 Jul 12 22:12:14.165125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 388/767] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jul 12 22:12:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:14.175559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9ec7689f-f9ed-43b0-923e-d9a825f5ff99 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b669caee0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:14.205419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9ec7689f-f9ed-43b0-923e-d9a825f5ff99 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 286 microversion: 2.1 time: 0.033620 Jul 12 22:12:14.206026 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 380/768] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:14 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:14.321602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:14.322119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:14.329230 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:14.329687 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:14.330456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:14.330896 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:14.459253 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:14.468233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:14.469773 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:14.470927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2da0fb09-2905-45df-987a-1aea76fb2921 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.154040 Jul 12 22:12:14.471483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 389/769] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:14 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:12:15.218897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7e8415b1-1f56-44a5-994e-8c23374e5e69 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b669e6310>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:15.249562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7e8415b1-1f56-44a5-994e-8c23374e5e69 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 286 microversion: 2.1 time: 0.036163 Jul 12 22:12:15.250148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 381/770] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:15 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:15.489822 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:15.490348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:15.497399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:15.497857 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:15.498633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:15.499068 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:15.633665 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:15.642442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:15.643929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:15.645134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0d8bbfa6-06f0-48da-9a6a-733af96b357b tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.159602 Jul 12 22:12:15.645686 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 390/771] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:15 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:12:16.262925 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e8d786e8-dd37-4610-91fc-89908c7140ed tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b668ef280>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:16.296590 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e8d786e8-dd37-4610-91fc-89908c7140ed tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 286 microversion: 2.1 time: 0.038980 Jul 12 22:12:16.297212 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 382/772] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:16 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:16.664004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:16.664587 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:16.672438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:16.672924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:16.673694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:16.674134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:16.808726 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:16.818626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:16.820275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:16.821565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3359c0e0-48c8-4c8e-99b2-3b64e43411ba tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1723 microversion: 2.20 time: 0.161442 Jul 12 22:12:16.822126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 391/773] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:16 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:12:17.308341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b8167461-f8e3-4936-b7ac-4460c2e6f90a tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b66907790>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:17.339292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b8167461-f8e3-4936-b7ac-4460c2e6f90a tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 287 microversion: 2.1 time: 0.035132 Jul 12 22:12:17.339870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 383/774] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:17 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:17.352539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9409986-f976-4bf4-be1c-7b45aea02b67 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6aa23550>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:17.417256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9409986-f976-4bf4-be1c-7b45aea02b67 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 202 len: 0 microversion: 2.1 time: 0.070210 Jul 12 22:12:17.417826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 392/775] 10.222.0.44 () {58 vars in 1253 bytes} [Tue Jul 12 22:12:17 2022] DELETE /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:12:17.426187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c729ff3a-adae-4d81-90ae-ce12b9bc6d94 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b669753a0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:17.459305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c729ff3a-adae-4d81-90ae-ce12b9bc6d94 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 200 len: 286 microversion: 2.1 time: 0.036844 Jul 12 22:12:17.459876 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 384/776] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:17 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:17.674334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f17a6e32-3d28-42cd-8214-c7703e319766 req-bb4a9ee4-9a07-4b6d-99d8-db48f8fba794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec9a2bb-da65-4c71-b5bc-2d71ff00c201", "name": "network-vif-deleted", "tag": "4f4a4c96-ae33-430a-b8b3-9d38221a1a04"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:17.683055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f17a6e32-3d28-42cd-8214-c7703e319766 req-bb4a9ee4-9a07-4b6d-99d8-db48f8fba794 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:17.683515 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f17a6e32-3d28-42cd-8214-c7703e319766 req-bb4a9ee4-9a07-4b6d-99d8-db48f8fba794 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:17.697084 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f17a6e32-3d28-42cd-8214-c7703e319766 req-bb4a9ee4-9a07-4b6d-99d8-db48f8fba794 service nova] Creating event network-vif-deleted:4f4a4c96-ae33-430a-b8b3-9d38221a1a04 for instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 on hv-cinder-80295 Jul 12 22:12:17.704445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f17a6e32-3d28-42cd-8214-c7703e319766 req-bb4a9ee4-9a07-4b6d-99d8-db48f8fba794 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033935 Jul 12 22:12:17.708443 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 393/777] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:17.843192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:17.845273 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:17.855359 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:17.855899 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:17.857415 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:17.858049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:17.894931 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:17.895503 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:17.896058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lazy-loading 'fault' on Instance uuid 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:12:17.956440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:17.973991 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:17.976020 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a746b42824c4d13a1d0b0f2c5831259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807d2d1b808448bca8aaf30389c8c571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:17.977548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-be57c6c8-aed6-4ee0-99a9-e4b9075764cf tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 200 len: 1371 microversion: 2.20 time: 0.141237 Jul 12 22:12:17.978349 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 385/778] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:17 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 22:12:18.474370 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01e1aec2-9c59-41f2-932e-f30b0058e1cd tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6aa233a0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:18.514161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-01e1aec2-9c59-41f2-932e-f30b0058e1cd tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] HTTP exception thrown: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01e1aec2-9c59-41f2-932e-f30b0058e1cd tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Request method failure captured: Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 HTTP/1.1 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfG8yu_Gawd6f2nXxJ_8V0fjFb-Pmqx6lFyIDskn84MhK67dSY6X73NKSh9nV7zUEmtnrzUWy-gHYXt6vZmqUQd-v3AQUJraYCDOi2Gyia1bjv-v8McZCvq5Jokb9JO0Yyy4_yhgT7srdd2tciP9E2aUW0RrxFJgzzZkrOfpyvyc7eM Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:18.516661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8f382b789a354a558d9e84a899da2a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 4d89525cb4294b5ab7ea8d80eacbf837 Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '57687204-7716-4ba3-9f85-1a6e9e515080'} Jul 12 22:12:18.518004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. (HTTP 404) (Request-ID: req-465983cf-1767-4c4a-8fb2-21c0d312755e) Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.519326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:18.520894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 22:12:18.522265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. Jul 12 22:12:18.523735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:18.525718 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01e1aec2-9c59-41f2-932e-f30b0058e1cd tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Returning 404 to user: Snapshot 57687204-7716-4ba3-9f85-1a6e9e515080 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:18.526585 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01e1aec2-9c59-41f2-932e-f30b0058e1cd tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080" status: 404 len: 111 microversion: 2.1 time: 0.059293 Jul 12 22:12:18.527151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 394/779] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jul 12 22:12:18 2022] GET /compute/v2.1/os-snapshots/57687204-7716-4ba3-9f85-1a6e9e515080 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:18.538419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2b154186-26af-4fdd-ac33-ecbcadabf85c tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b66975040>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:18.643860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2b154186-26af-4fdd-ac33-ecbcadabf85c tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 202 len: 0 microversion: 2.1 time: 0.110504 Jul 12 22:12:18.644435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 386/780] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:12:18 2022] DELETE /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:12:18.652700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7fd65134-50ea-4caf-8ca9-1329ee46af57 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6a952b80>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:18.716055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7fd65134-50ea-4caf-8ca9-1329ee46af57 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 200 len: 345 microversion: 2.1 time: 0.066472 Jul 12 22:12:18.719432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 395/781] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:12:18 2022] GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:18.996197 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:18.996870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:19.003489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:19.003941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:19.004734 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:19.005187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:19.019435 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 HTTP/1.1 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:19.021126 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:19.022431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '3ec9a2bb-da65-4c71-b5bc-2d71ff00c201'} Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:19.023462 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:19.025272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.026847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:19.026847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-59428a87-6797-4706-958d-77970b3b8c6c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 404 len: 111 microversion: 2.20 time: 0.030190 Jul 12 22:12:19.026847 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 387/782] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:18 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:12:19.032002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41fb0105-3101-46f8-8321-862c39939155 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '.version_select at 0x7f1b6a952af0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:19.050382 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41fb0105-3101-46f8-8321-862c39939155 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632708549" status: 204 len: 0 microversion: 2.20 time: 0.022941 Jul 12 22:12:19.051057 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 396/783] 10.222.0.44 () {60 vars in 1258 bytes} [Tue Jul 12 22:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632708549 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 22:12:19.728436 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5320dcdd-8ceb-4c08-95fa-2b6a878ba8c2 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b66975b80>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:19.759074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-5320dcdd-8ceb-4c08-95fa-2b6a878ba8c2 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] HTTP exception thrown: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5320dcdd-8ceb-4c08-95fa-2b6a878ba8c2 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Request method failure captured: Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed HTTP/1.1 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfG8yu_Gawd6f2nXxJ_8V0fjFb-Pmqx6lFyIDskn84MhK67dSY6X73NKSh9nV7zUEmtnrzUWy-gHYXt6vZmqUQd-v3AQUJraYCDOi2Gyia1bjv-v8McZCvq5Jokb9JO0Yyy4_yhgT7srdd2tciP9E2aUW0RrxFJgzzZkrOfpyvyc7eM Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:19.761423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8f382b789a354a558d9e84a899da2a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4d89525cb4294b5ab7ea8d80eacbf837 Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed'} Jul 12 22:12:19.763308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. (HTTP 404) (Request-ID: req-080a3990-d830-4670-84d3-7c9a2a01e118) Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.764378 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:19.765998 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 22:12:19.767361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5320dcdd-8ceb-4c08-95fa-2b6a878ba8c2 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Returning 404 to user: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:19.768751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5320dcdd-8ceb-4c08-95fa-2b6a878ba8c2 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 404 len: 109 microversion: 2.1 time: 0.038160 Jul 12 22:12:19.772521 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 388/784] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:12:19 2022] GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:19.785924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eab2a9b3-b0ca-43ba-9322-597081057109 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b6a95e3a0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:19.818566 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-eab2a9b3-b0ca-43ba-9322-597081057109 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] HTTP exception thrown: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eab2a9b3-b0ca-43ba-9322-597081057109 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Request method failure captured: Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed HTTP/1.1 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfG8yu_Gawd6f2nXxJ_8V0fjFb-Pmqx6lFyIDskn84MhK67dSY6X73NKSh9nV7zUEmtnrzUWy-gHYXt6vZmqUQd-v3AQUJraYCDOi2Gyia1bjv-v8McZCvq5Jokb9JO0Yyy4_yhgT7srdd2tciP9E2aUW0RrxFJgzzZkrOfpyvyc7eM Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:19.820599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8f382b789a354a558d9e84a899da2a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 4d89525cb4294b5ab7ea8d80eacbf837 Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed'} Jul 12 22:12:19.822266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. (HTTP 404) (Request-ID: req-de65d6ac-f1e7-4a14-80fb-af52a542ad84) Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.823148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 22:12:19.824285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 22:12:19.826071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eab2a9b3-b0ca-43ba-9322-597081057109 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Returning 404 to user: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eab2a9b3-b0ca-43ba-9322-597081057109 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 404 len: 109 microversion: 2.1 time: 0.042798 Jul 12 22:12:19.827651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 397/785] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:12:19 2022] DELETE /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:19.831848 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5412b8e2-8816-4308-9b4a-6e7152c37d45 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Calling method '.version_select at 0x7f1b66975700>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:19.860943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-5412b8e2-8816-4308-9b4a-6e7152c37d45 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] HTTP exception thrown: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5412b8e2-8816-4308-9b4a-6e7152c37d45 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Request method failure captured: Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed HTTP/1.1 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfG8yu_Gawd6f2nXxJ_8V0fjFb-Pmqx6lFyIDskn84MhK67dSY6X73NKSh9nV7zUEmtnrzUWy-gHYXt6vZmqUQd-v3AQUJraYCDOi2Gyia1bjv-v8McZCvq5Jokb9JO0Yyy4_yhgT7srdd2tciP9E2aUW0RrxFJgzzZkrOfpyvyc7eM Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:19.863125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8f382b789a354a558d9e84a899da2a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8f382b789a354a558d9e84a899da2a50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 8f382b789a354a558d9e84a899da2a50 Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1262094825 Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4d89525cb4294b5ab7ea8d80eacbf837 Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1262094825-project Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed'} Jul 12 22:12:19.865161 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. (HTTP 404) (Request-ID: req-3b553719-5b85-49aa-a9a3-daa8a4800cdc) Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.865988 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 22:12:19.867187 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 22:12:19.869256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5412b8e2-8816-4308-9b4a-6e7152c37d45 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] Returning 404 to user: Volume a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5412b8e2-8816-4308-9b4a-6e7152c37d45 tempest-VolumesSnapshotsTestJSON-1262094825 tempest-VolumesSnapshotsTestJSON-1262094825-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed" status: 404 len: 109 microversion: 2.1 time: 0.037544 Jul 12 22:12:19.871600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 389/786] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jul 12 22:12:19 2022] GET /compute/v2.1/os-volumes/a9b9b6e1-09b7-4ff0-9f8a-897c7f1dc3ed => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:12:20.848415 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:20.849127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:20.855546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:20.856012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:20.856862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:20.857306 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:20.861638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:20.872897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 HTTP/1.1 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:20.874564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.876315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '3ec9a2bb-da65-4c71-b5bc-2d71ff00c201'} Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:20.877164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.878784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.880435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:20.880435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1bcae3f8-48d9-4c8f-9e7f-f6f8c747cd4c tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 404 len: 111 microversion: 2.20 time: 0.033020 Jul 12 22:12:20.880435 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 398/787] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jul 12 22:12:20 2022] DELETE /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:12:20.886064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:20.886712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:20.894318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:20.894802 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:20.895589 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:20.896028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:20.913054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 HTTP/1.1 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:20.914584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.916168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '3ec9a2bb-da65-4c71-b5bc-2d71ff00c201'} Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:20.917166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. Jul 12 22:12:20.918596 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:20.920124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance 3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:20.920124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c9443b2e-c5f1-4671-b33b-2a475931004e tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201" status: 404 len: 111 microversion: 2.20 time: 0.034540 Jul 12 22:12:20.920124 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 390/788] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:20 2022] GET /compute/v2.1/servers/3ec9a2bb-da65-4c71-b5bc-2d71ff00c201 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 22:12:22.070315 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:22.070894 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:22.086129 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:22.086582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:22.087356 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:22.089201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:22.103299 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b HTTP/1.1 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:12:22.104931 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.106602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'a50872f4-2ebb-4811-852b-3413585e6e7b'} Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:22.107775 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.109529 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.111432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:22.111432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3f75b0d1-e3b3-46c2-9b46-54b0511fe258 tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 404 len: 111 microversion: 2.20 time: 0.040322 Jul 12 22:12:22.111432 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 399/789] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jul 12 22:12:22 2022] DELETE /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 22:12:22.115183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:22.115801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] [instance: a50872f4-2ebb-4811-852b-3413585e6e7b] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:22.122567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:22.123019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:22.123787 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:22.124219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:22.142617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] HTTP exception thrown: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Request method failure captured: Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b HTTP/1.1 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfBDtnpOrOOSSU56RDevSvJoodJ_VztLa1efu0xSU-WUvL4S3fR6rvm65MmXAA2xU96HXFGpidnm9rxweP09b8k2IrkmMv6SRE1w9rvp5JpfU58akuEn0St1_Nuw46HAmhvHP4-Mplm11nmq6uv5Zd7Dc0ZXbMiMjWHkdCcqFQfLVaU Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:12:22.144398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/807d2d1b808448bca8aaf30389c8c571"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 807d2d1b808448bca8aaf30389c8c571 Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2019991699 Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 4a746b42824c4d13a1d0b0f2c5831259 Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2019991699-project Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.146077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'a50872f4-2ebb-4811-852b-3413585e6e7b'} Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:12:22.150520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. Jul 12 22:12:22.151972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:12:22.153346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] Returning 404 to user: Instance a50872f4-2ebb-4811-852b-3413585e6e7b could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:12:22.153346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c89395e2-05d7-4344-ad19-a1683cf770fa tempest-AttachVolumeShelveTestJSON-2019991699 tempest-AttachVolumeShelveTestJSON-2019991699-project] 10.222.0.44 "GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b" status: 404 len: 111 microversion: 2.20 time: 0.034399 Jul 12 22:12:22.153346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 391/790] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jul 12 22:12:22 2022] GET /compute/v2.1/servers/a50872f4-2ebb-4811-852b-3413585e6e7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 22:12:32.265067 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:32.265976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:32.608380 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c3976699-0b36-45ec-bdfa-01ae7f55ba12 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: .version_select at 0x7f1b6a952e50>, body: {"keypair": {"name": "tempest-keypair-2052048013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG9vsHwB0XVxLW2SK3YhHZRHhPkpbRcLDMpGe+GO/82saIxUOGlt58Owcs1/2E6BWFrbWJky12Cy/K77UR2ZQcC4u1di3VPa3HPzR1VXTsbhcoeB3Nc5JkzCVQH9jai8g=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:32.623223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-c3976699-0b36-45ec-bdfa-01ae7f55ba12 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:12:32.627456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-c3976699-0b36-45ec-bdfa-01ae7f55ba12 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for user 2d0d387beaf842c3b5978210e504fbed and project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:12:32.657256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c3976699-0b36-45ec-bdfa-01ae7f55ba12 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.398886 Jul 12 22:12:32.657964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 400/791] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:12:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:34.535207 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1619032401", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df24379e-7c0d-40d2-9b15-4897c7329299"}], "security_groups": [{"name": "tempest-securitygroup--1329797905"}], "key_name": "tempest-keypair-2052048013", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:34.543720 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:34.544483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:34.665089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] validate_networks() for [('df24379e-7c0d-40d2-9b15-4897c7329299', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:12:35.208021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:12:35.208517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:12:35.209091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:12:35.209621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:12:35.210162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:12:35.221361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:35.221817 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:35.222721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:35.223294 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:35.241738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:12:35.246172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for user 2d0d387beaf842c3b5978210e504fbed and project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:12:35.261565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:12:35.264267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:12:35.315254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d46ef548-9ad6-4bce-a48b-9de12ce525b1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.784247 Jul 12 22:12:35.321004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 392/792] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:12:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:12:35.328204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3fcc4f33-df2c-477a-8187-dbcdadd62552 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:35.328839 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3fcc4f33-df2c-477a-8187-dbcdadd62552 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:35.413384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3fcc4f33-df2c-477a-8187-dbcdadd62552 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:35.421587 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3fcc4f33-df2c-477a-8187-dbcdadd62552 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1238 microversion: 2.1 time: 0.098667 Jul 12 22:12:35.422516 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 401/793] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:35 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:36.438739 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:36.439966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:36.451983 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:36.452444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:36.453297 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:36.453739 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:36.542663 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:36.553246 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-82cfc6b6-baef-4024-8f7b-9be401eac8ce tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1298 microversion: 2.1 time: 0.118178 Jul 12 22:12:36.554372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 393/794] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:36 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:37.583250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:37.583897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:37.590549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:37.591009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:37.591787 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:37.592233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:37.842676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:37.851746 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aebcbf3f-1443-4851-a6d3-3e66d1afc5f7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.272235 Jul 12 22:12:37.852394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 402/795] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:37 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:38.049298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-1b4cb851-6a7d-40de-ad6c-8618d73bca90 req-b893dfce-b715-46ec-99d0-c9c23190fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebe3a3a-5736-4df3-a820-a400fb366508", "tag": "439fc499-dc30-4f59-b951-7832ab8a480e"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:38.063298 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-1b4cb851-6a7d-40de-ad6c-8618d73bca90 req-b893dfce-b715-46ec-99d0-c9c23190fbdc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:38.063744 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-1b4cb851-6a7d-40de-ad6c-8618d73bca90 req-b893dfce-b715-46ec-99d0-c9c23190fbdc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:38.083094 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-1b4cb851-6a7d-40de-ad6c-8618d73bca90 req-b893dfce-b715-46ec-99d0-c9c23190fbdc service nova] Creating event network-changed:439fc499-dc30-4f59-b951-7832ab8a480e for instance 1ebe3a3a-5736-4df3-a820-a400fb366508 on hv-cinder-80295 Jul 12 22:12:38.088510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-1b4cb851-6a7d-40de-ad6c-8618d73bca90 req-b893dfce-b715-46ec-99d0-c9c23190fbdc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042917 Jul 12 22:12:38.089689 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 394/796] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:38.868422 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:38.869049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:38.875862 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:38.876308 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:38.877097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:38.877534 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:39.010329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:39.018453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b4c16f8d-65da-4851-aa01-db232acf930e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.153922 Jul 12 22:12:39.019018 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 403/797] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:38 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:40.037312 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:40.038033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:40.045248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:40.045697 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:40.046493 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:40.046972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:40.185613 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:40.193531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d63bbf0f-ca45-4720-a785-171629d89183 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.160938 Jul 12 22:12:40.194096 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 395/798] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:40 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:41.210673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:41.211443 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:41.218097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:41.218477 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:41.219240 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:41.219672 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:41.359423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:41.370313 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d2ce7daa-306f-432e-9de0-2008173137a5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.163566 Jul 12 22:12:41.370905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 404/799] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:41 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:42.387451 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:42.388056 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:42.394746 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:42.395199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:42.395969 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:42.396407 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:42.532204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:42.539932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c55d65a6-5dac-4e05-a298-2f70c42bf27c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.156430 Jul 12 22:12:42.540509 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 396/800] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:42 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:43.556421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:43.557051 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:43.564733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:43.565211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:43.566009 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:43.566522 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:43.700924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:43.710064 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aea0cabc-74d8-4c59-854f-5e92bbe7066f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.157468 Jul 12 22:12:43.710657 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 405/801] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:43 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:44.291859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-2fc6ffb9-1fe9-43d2-a372-2888cc252a09 req-a0cc1d0b-99bd-40f2-9842-f5317cf703f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebe3a3a-5736-4df3-a820-a400fb366508", "name": "network-vif-plugged", "status": "completed", "tag": "439fc499-dc30-4f59-b951-7832ab8a480e"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:44.305698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2fc6ffb9-1fe9-43d2-a372-2888cc252a09 req-a0cc1d0b-99bd-40f2-9842-f5317cf703f8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:44.306166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2fc6ffb9-1fe9-43d2-a372-2888cc252a09 req-a0cc1d0b-99bd-40f2-9842-f5317cf703f8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:44.318425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-2fc6ffb9-1fe9-43d2-a372-2888cc252a09 req-a0cc1d0b-99bd-40f2-9842-f5317cf703f8 service nova] Creating event network-vif-plugged:439fc499-dc30-4f59-b951-7832ab8a480e for instance 1ebe3a3a-5736-4df3-a820-a400fb366508 on hv-cinder-80295 Jul 12 22:12:44.323442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-2fc6ffb9-1fe9-43d2-a372-2888cc252a09 req-a0cc1d0b-99bd-40f2-9842-f5317cf703f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037902 Jul 12 22:12:44.324354 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 397/802] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:44.727258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:44.727866 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:44.735520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:44.735947 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:44.736741 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:44.737169 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:44.868244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:44.875903 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8dd789dc-03fb-48a3-930a-961f6ddd61d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.152535 Jul 12 22:12:44.877141 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 406/803] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:44 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:45.893458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:45.894166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:45.896155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:45.896872 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:45.904920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:45.905374 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:45.906427 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:45.906766 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:46.043402 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:46.050859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f1314556-0427-4bfe-aeff-90fff97ef5b7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1364 microversion: 2.1 time: 0.161826 Jul 12 22:12:46.051457 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 398/804] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:45 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:47.068136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:47.068767 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:47.070630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:12:47.076458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:47.076940 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:47.077720 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:47.078158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:47.215241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:12:47.222700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a8bd89aa-c8ce-42ba-84d4-1fb2fdc18665 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1549 microversion: 2.1 time: 0.158636 Jul 12 22:12:47.223258 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 407/805] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:12:47 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:12:47.239715 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:12:47.240419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:12:47.247760 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:47.248219 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:47.249023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:47.249472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:47.327362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e8dfcaa4-bca1-4503-b844-2dfb5f384c72 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091482 Jul 12 22:12:47.327980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 399/806] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:12:47 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:12:48.394644 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5a25a071-1d3a-4845-a0d3-cbdabfe49d63 req-5b840502-8fec-4384-957b-f50d56c85c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebe3a3a-5736-4df3-a820-a400fb366508", "tag": "439fc499-dc30-4f59-b951-7832ab8a480e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:12:48.403553 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5a25a071-1d3a-4845-a0d3-cbdabfe49d63 req-5b840502-8fec-4384-957b-f50d56c85c49 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:12:48.404033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5a25a071-1d3a-4845-a0d3-cbdabfe49d63 req-5b840502-8fec-4384-957b-f50d56c85c49 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:12:48.415482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5a25a071-1d3a-4845-a0d3-cbdabfe49d63 req-5b840502-8fec-4384-957b-f50d56c85c49 service nova] Creating event network-changed:439fc499-dc30-4f59-b951-7832ab8a480e for instance 1ebe3a3a-5736-4df3-a820-a400fb366508 on hv-cinder-80295 Jul 12 22:12:48.421266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5a25a071-1d3a-4845-a0d3-cbdabfe49d63 req-5b840502-8fec-4384-957b-f50d56c85c49 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153275 Jul 12 22:12:48.421869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 408/807] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:16.037419 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:16.038179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=34 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:16.042621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:16.043122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:16.051208 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:16.051660 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:16.052431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:16.052910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:16.077783 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:13:16.155978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-12fe17e8-cc44-482f-a0f6-70e786f0913b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 204 len: 0 microversion: 2.1 time: 0.119733 Jul 12 22:13:16.156495 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 400/808] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:13:16 2022] DELETE /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:13:16.170612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:16.171336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:16.174153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:16.175547 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=38 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:16.182745 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:16.183246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:16.184221 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:16.184615 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:16.333897 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:16.342323 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7b880bb1-458d-4c3c-b2dc-c0e716e4b2f9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1578 microversion: 2.1 time: 0.178140 Jul 12 22:13:16.343327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 409/809] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:16 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:17.363019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:17.364249 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:17.372744 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:17.373202 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:17.373981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:17.374423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:17.503409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:17.510985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-da57c3b3-34a4-4959-a323-bd55746b5fc3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1578 microversion: 2.1 time: 0.154671 Jul 12 22:13:17.511551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 401/810] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:17 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:18.528591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:18.529254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:18.535442 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:18.535883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:18.536634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:18.537085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:18.669112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:18.677220 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ceb7ab2b-7aab-44cc-8ef6-d26b7eea79f1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1578 microversion: 2.1 time: 0.152552 Jul 12 22:13:18.677777 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 410/811] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:18 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:19.694762 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:19.695356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:19.702547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:19.702987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:19.703748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:19.704183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:19.846071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:19.853639 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-860ac200-53c5-4b59-a24e-3445492901cf tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1578 microversion: 2.1 time: 0.162987 Jul 12 22:13:19.854209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 402/812] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:19 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:20.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:20.872139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:20.881482 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:20.882081 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:20.883224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:20.883704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:21.217223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:21.225832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c0c2cae-20ed-4695-bd01-995dbb7aa834 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 200 len: 1510 microversion: 2.1 time: 0.358273 Jul 12 22:13:21.226527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 411/813] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:20 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:21.284958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-4d7b7a6a-c00a-4080-a8e6-4191d713ecdd req-183f4824-50da-40b5-bc51-56f3cec7e6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3061dbc-2e72-428f-b5d7-12ec63ca924e", "name": "network-vif-deleted", "tag": "b6de339e-8d74-49bd-ae6f-60a5b8e0f582"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:21.296258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-4d7b7a6a-c00a-4080-a8e6-4191d713ecdd req-183f4824-50da-40b5-bc51-56f3cec7e6dc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:21.296997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-4d7b7a6a-c00a-4080-a8e6-4191d713ecdd req-183f4824-50da-40b5-bc51-56f3cec7e6dc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:21.312967 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-4d7b7a6a-c00a-4080-a8e6-4191d713ecdd req-183f4824-50da-40b5-bc51-56f3cec7e6dc service nova] Creating event network-vif-deleted:b6de339e-8d74-49bd-ae6f-60a5b8e0f582 for instance a3061dbc-2e72-428f-b5d7-12ec63ca924e on hv-cinder-80295 Jul 12 22:13:21.319880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-4d7b7a6a-c00a-4080-a8e6-4191d713ecdd req-183f4824-50da-40b5-bc51-56f3cec7e6dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038651 Jul 12 22:13:21.320491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 403/814] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:22.243434 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:22.244065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:22.251241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:22.251756 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:22.252544 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:22.252989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:22.267265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] HTTP exception thrown: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Request method failure captured: Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e HTTP/1.1 Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfFYDP8FFPfo7G2eD9jBKzZSQ9E_Q5VbsglAszx-VgaFNIWOy6h7_YX6dqLSfrSqgvwHDte9KDHRxRWWbYpMomRkMAskhKdoqr1XB-pL2mcNyCCBCuECpUX8vWLpIFp54zbqqCFqG4gaxG8GxUZ4b7JrpMva71Vg_oElRlk_AKvOyJI Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:13:22.268927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_80e867d86756459f9e4f53a4238d393d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-678416096 Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 24a41c09f2e4487f9897c9888a0d752f Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:13:22.270654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'a3061dbc-2e72-428f-b5d7-12ec63ca924e'} Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:13:22.271528 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:13:22.272865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:13:22.274485 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Returning 404 to user: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:13:22.274485 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ebf82515-ea9b-4e28-ba6f-6ab6583022df tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 404 len: 111 microversion: 2.1 time: 0.030888 Jul 12 22:13:22.274485 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 412/815] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:22 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:13:22.375103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1977636114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1581295142", "security_groups": [{"name": "tempest-secgroup-smoke-1104170630"}], "block_device_mapping_v2": [{"uuid": "17318419-269d-421d-91ca-58193f5c033b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "246c2727-fc8d-41fb-b4a0-57699ab0459c"}]}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:22.493688 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] validate_networks() for [('246c2727-fc8d-41fb-b4a0-57699ab0459c', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:13:23.102336 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:13:23.102735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:13:23.103205 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:13:23.103604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:13:23.104001 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:13:23.113251 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:23.113695 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:23.114477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:23.114905 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:23.131472 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:13:23.135360 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for user 24a41c09f2e4487f9897c9888a0d752f and project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:13:23.192115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:13:23.195147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17318419-269d-421d-91ca-58193f5c033b',volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:13:23.326806 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4f20a1dd-51df-4ade-b38f-7a6eb6a36303 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955877 Jul 12 22:13:23.327572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 404/816] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:13:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:13:23.338744 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bc9c93a0-7b21-4d3a-95b4-72fdf8089329 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:23.339886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bc9c93a0-7b21-4d3a-95b4-72fdf8089329 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:23.407142 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bc9c93a0-7b21-4d3a-95b4-72fdf8089329 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:23.413851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bc9c93a0-7b21-4d3a-95b4-72fdf8089329 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1095 microversion: 2.1 time: 0.079516 Jul 12 22:13:23.414339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 413/817] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:23 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:24.432042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:24.432644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:24.440474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:24.440947 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:24.441738 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:24.442166 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:24.508234 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:24.516572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1ae9a5f7-61de-4663-a836-846aac0b4260 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1211 microversion: 2.1 time: 0.088866 Jul 12 22:13:24.517182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 405/818] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:24 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:25.534921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:25.535705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:25.543225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:25.543675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:25.544653 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:25.545122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:25.634468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-c2793274-d227-465e-b599-6b0d058de776 req-14f42d24-767e-4382-9a18-e15ed16d1dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633c7eb7-6be2-4733-a41d-2a96653a5213", "tag": "ac8da1e2-11e6-4fdd-80f8-a62b641530e1"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:25.644793 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c2793274-d227-465e-b599-6b0d058de776 req-14f42d24-767e-4382-9a18-e15ed16d1dfc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:25.645584 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c2793274-d227-465e-b599-6b0d058de776 req-14f42d24-767e-4382-9a18-e15ed16d1dfc service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:25.659471 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-c2793274-d227-465e-b599-6b0d058de776 req-14f42d24-767e-4382-9a18-e15ed16d1dfc service nova] Creating event network-changed:ac8da1e2-11e6-4fdd-80f8-a62b641530e1 for instance 633c7eb7-6be2-4733-a41d-2a96653a5213 on hv-cinder-80295 Jul 12 22:13:25.664521 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-c2793274-d227-465e-b599-6b0d058de776 req-14f42d24-767e-4382-9a18-e15ed16d1dfc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034927 Jul 12 22:13:25.667172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 406/819] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:25.829107 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:25.837374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1dfc7bc4-cd52-45b9-80ad-8f3cbb5c6aed tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.306569 Jul 12 22:13:25.838213 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 414/820] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:25 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:26.856409 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:26.860541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:26.867280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:26.867732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:26.868684 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:26.869160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:27.015192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:27.022897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-21a1ab24-a34b-4ab6-ba2b-01b19dea4d44 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.171206 Jul 12 22:13:27.023510 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 407/821] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:26 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:28.041460 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:28.042294 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:28.050159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:28.050495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:28.051279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:28.051714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:28.345714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:28.353731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-43249b33-5ad5-4663-be54-c531ef4194be tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.316653 Jul 12 22:13:28.354602 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 415/822] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:28 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:29.370560 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:29.371338 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:29.378464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:29.379269 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:29.380146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:29.380678 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:29.535562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:29.543779 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e604cdca-170e-4dcc-be9f-7ae16154f0bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.177004 Jul 12 22:13:29.545987 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 408/823] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:29 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:30.563263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:30.564200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:30.571981 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:30.572405 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:30.573209 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:30.573649 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:30.826147 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:30.841638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ab22057-1b87-49fa-9cc1-7a8483987b66 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.282278 Jul 12 22:13:30.842808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 416/824] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:30 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:31.629499 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:31.630025 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:31.636555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:31.636965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:31.637913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:31.638353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:31.671190 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-69a3624a-307c-44e3-9508-c6db20e6ef6a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/ips" status: 200 len: 144 microversion: 2.1 time: 0.045463 Jul 12 22:13:31.671792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 409/825] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:13:31 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:31.861140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:31.861762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:31.868725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:31.869194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:31.870011 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:31.870455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:32.038507 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:32.053203 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-baa91d2a-5c46-4eb8-b7b0-989de0d3bbcc tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.197914 Jul 12 22:13:32.054359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 417/826] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:31 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:33.071302 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:33.072021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:33.086498 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:33.090355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:33.091894 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:33.092455 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:33.124577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:33.141420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:33.381329 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:33.390226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b8a44319-2377-4b09-8be1-0f43e911848d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.323177 Jul 12 22:13:33.396949 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 410/827] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:33 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:34.221784 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2583374-2056-4e78-974e-e73f5933310a"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:34.222961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:34.230692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:34.241417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:34.242178 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:34.243019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:34.243424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:34.411363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:34.414112 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:34.429117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:34.429940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:34.431132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:34.432551 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:34.623699 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91f5c908-d3e2-4e2c-933a-c65baa363618 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407272 Jul 12 22:13:34.624662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 418/828] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:13:34 2022] POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:34.678366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:34.695645 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-47fd5b59-7909-441e-bfc0-4383f34672c9 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.289033 Jul 12 22:13:34.698879 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 411/829] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:34 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:35.717265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:35.718146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:35.728907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:35.729631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:35.730616 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:35.731257 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:36.025923 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:36.040137 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4837c40f-2016-45d0-b0e9-dc891b51c110 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.327083 Jul 12 22:13:36.041570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 419/830] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:35 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:37.057776 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:37.058382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:37.070026 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:37.070471 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:37.071420 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:37.071683 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:37.231178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:37.241043 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b0c44e62-ee2c-4bf6-966f-c647e8a234d4 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.186905 Jul 12 22:13:37.241965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 412/831] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:37 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:13:37.375121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1426587d-b500-4c49-865a-2feadc2fd918 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Action: 'create', calling method: .version_select at 0x7f1b6a95eb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1291194408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOusv/7xRCDtsGu7DZxW9Tm20XsiDklR+KqAnLmlnoR/Njw50IB1Aq2RnrJEmxvG0+zFGU618OZdhJhzJZc7M3p8zMhPQEJNqQ5wO2CgL8X99waWMFJVXQ1OCNhsWL6yEw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:37.391595 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-1426587d-b500-4c49-865a-2feadc2fd918 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Getting quotas for project b46992df6b784a7abd397b8f3aeb827a. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:13:37.395816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-1426587d-b500-4c49-865a-2feadc2fd918 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Getting quotas for user 624bdc53a8b34b46b5004532716b3985 and project b46992df6b784a7abd397b8f3aeb827a. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:13:37.418499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1426587d-b500-4c49-865a-2feadc2fd918 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242007 Jul 12 22:13:37.425847 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 420/832] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:13:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:13:38.260125 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:38.260775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:38.272789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:38.273251 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:38.274037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:38.274477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:38.484605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:38.494768 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b9f46b29-61ae-41d7-9c6c-b332b056bb95 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.239280 Jul 12 22:13:38.496067 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 413/833] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:38 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:38.768097 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b863dc77-535a-4023-bfe0-8db2f93edfbb req-427df511-2248-4397-8cf2-949b97d67cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633c7eb7-6be2-4733-a41d-2a96653a5213", "name": "network-vif-plugged", "status": "completed", "tag": "ac8da1e2-11e6-4fdd-80f8-a62b641530e1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:38.795868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b863dc77-535a-4023-bfe0-8db2f93edfbb req-427df511-2248-4397-8cf2-949b97d67cb3 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:38.797462 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b863dc77-535a-4023-bfe0-8db2f93edfbb req-427df511-2248-4397-8cf2-949b97d67cb3 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:38.810958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b863dc77-535a-4023-bfe0-8db2f93edfbb req-427df511-2248-4397-8cf2-949b97d67cb3 service nova] Creating event network-vif-plugged:ac8da1e2-11e6-4fdd-80f8-a62b641530e1 for instance 633c7eb7-6be2-4733-a41d-2a96653a5213 on hv-cinder-80295 Jul 12 22:13:38.818295 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b863dc77-535a-4023-bfe0-8db2f93edfbb req-427df511-2248-4397-8cf2-949b97d67cb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053536 Jul 12 22:13:38.819054 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 421/834] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:39.513825 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:39.514868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:39.521489 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:39.521942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:39.522794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:39.523318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:39.670871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:39.679651 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-848c6a43-254a-486e-9f7b-7e572929df2a tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1267 microversion: 2.1 time: 0.170127 Jul 12 22:13:39.680226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 414/835] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:39 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:40.702950 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:40.703674 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:40.711101 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:40.711611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:40.712421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:40.712898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:40.867399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:40.876384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3a4bc39e-eadc-4e4d-9a42-bb9c31f5dc2d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1455 microversion: 2.1 time: 0.180085 Jul 12 22:13:40.877023 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 422/836] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:40 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1455 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:40.893417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:40.894035 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:40.900686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:40.901403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:40.902396 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:40.902849 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:41.082786 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:41.091341 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4ad93721-673e-425a-8039-3d1b26e2c7d3 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1455 microversion: 2.1 time: 0.201338 Jul 12 22:13:41.091942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 415/837] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:40 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1455 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:13:42.430888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2a5cb35-da8e-4770-a13c-fe138e60ef28 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:42.442999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a5cb35-da8e-4770-a13c-fe138e60ef28 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:42.442999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a5cb35-da8e-4770-a13c-fe138e60ef28 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:42.518361 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b2a5cb35-da8e-4770-a13c-fe138e60ef28 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Going to try to stop instance {{(pid=117938) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 22:13:42.576920 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2a5cb35-da8e-4770-a13c-fe138e60ef28 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action" status: 202 len: 0 microversion: 2.1 time: 0.161862 Jul 12 22:13:42.577500 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 423/838] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:13:42 2022] POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:13:42.587022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:42.588473 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:42.598808 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:42.599531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:42.600938 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:42.603347 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:42.866714 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:42.876652 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2fa378c6-3f99-4749-b824-ee2211eedd0a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.293649 Jul 12 22:13:42.877276 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 416/839] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:42 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:43.197254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-4ac0b351-a18f-461d-af9b-29ff44a4a327 req-88738ee3-deca-4bcb-821d-844dea73e641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633c7eb7-6be2-4733-a41d-2a96653a5213", "tag": "ac8da1e2-11e6-4fdd-80f8-a62b641530e1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:43.206438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4ac0b351-a18f-461d-af9b-29ff44a4a327 req-88738ee3-deca-4bcb-821d-844dea73e641 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:43.207120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4ac0b351-a18f-461d-af9b-29ff44a4a327 req-88738ee3-deca-4bcb-821d-844dea73e641 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:43.219727 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-4ac0b351-a18f-461d-af9b-29ff44a4a327 req-88738ee3-deca-4bcb-821d-844dea73e641 service nova] Creating event network-changed:ac8da1e2-11e6-4fdd-80f8-a62b641530e1 for instance 633c7eb7-6be2-4733-a41d-2a96653a5213 on hv-cinder-80295 Jul 12 22:13:43.225179 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-4ac0b351-a18f-461d-af9b-29ff44a4a327 req-88738ee3-deca-4bcb-821d-844dea73e641 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031804 Jul 12 22:13:43.225777 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 424/840] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:13:43.895284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:43.895957 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:43.902717 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:43.903192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:43.904073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:43.904561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:43.910817 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:44.056140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:44.065331 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-74c12c21-f800-476f-b8b9-e7f9bf439964 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.174144 Jul 12 22:13:44.066252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 417/841] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:43 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:45.083888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:45.084494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:45.091652 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:45.092136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:45.092933 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:45.093368 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:45.235333 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:45.243263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4fe2cd00-5eae-4ea0-b7d6-f658d44e4e61 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.163640 Jul 12 22:13:45.243823 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 425/842] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:45 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:46.263201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:46.263810 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:46.266132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:46.272975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:46.273421 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:46.274189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:46.274618 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:46.422093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:46.430215 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-40914d50-6667-412c-9615-672f21b3cc06 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.171531 Jul 12 22:13:46.430851 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 418/843] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:46 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:13:47.448567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:47.449244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:47.451736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:47.452418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:47.459728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:47.460197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:47.461029 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:47.461471 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:47.464942 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:13:47.603444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:47.612433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2a9f0f52-55c2-4e6d-9293-379194762598 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.167660 Jul 12 22:13:47.613059 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 426/844] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:47 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:48.630037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:48.630655 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:48.637968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:48.638423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:48.639193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:48.639634 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:48.780823 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:48.789356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9f415ff2-5729-4a58-a46f-b013d47acf49 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.163157 Jul 12 22:13:48.789928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 419/845] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:48 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:49.807243 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:49.807863 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:49.815564 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:49.816022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:49.816815 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:49.817256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:49.950194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:49.958135 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-661a2289-4c2d-4afb-9abb-9085ac0de071 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.155663 Jul 12 22:13:49.958738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 427/846] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:49 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:50.975566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:50.976181 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:50.983095 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:50.983552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:50.984335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:50.984794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:51.349158 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:51.357749 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-59b852c0-8442-4ae0-81b4-fbef234813df tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.386000 Jul 12 22:13:51.362227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 420/847] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:50 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:52.376045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:52.376662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:52.384461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:52.384979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:52.385831 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:52.386272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:52.534004 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:52.542140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-11fc7e61-2fed-4cb4-a8d0-5d3d565cda95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.170765 Jul 12 22:13:52.542715 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 428/848] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:52 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:53.135204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-414290183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1291194408", "security_groups": [{"name": "tempest-secgroup-smoke-1980551662"}], "networks": [{"uuid": "32e2eda6-3ed7-4209-8c66-f265acd3d061"}], "block_device_mapping_v2": [{"uuid": "724ff92b-f77d-48d9-9fb0-801381279673", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:53.250184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] validate_networks() for [('32e2eda6-3ed7-4209-8c66-f265acd3d061', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:13:53.560204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:53.561041 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:53.567360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:53.568356 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:53.569385 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:53.569815 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:53.626093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:13:53.626517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:13:53.627049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:13:53.627464 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:13:53.627924 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:13:53.645659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:53.646288 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:53.647022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:53.647456 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:53.671614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Getting quotas for project b46992df6b784a7abd397b8f3aeb827a. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:13:53.675830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Getting quotas for user 624bdc53a8b34b46b5004532716b3985 and project b46992df6b784a7abd397b8f3aeb827a. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:13:53.717452 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:53.726066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6ca1827d-265c-4df7-b7a0-1f805ec8a822 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.170115 Jul 12 22:13:53.726888 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 429/849] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:53 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:13:53.743585 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:13:53.745811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='724ff92b-f77d-48d9-9fb0-801381279673',volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:13:53.897101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9781afec-093a-4253-91ab-dba7a253ae8f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766001 Jul 12 22:13:53.897792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 421/850] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:13:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:13:53.907905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ef9b590-025a-45fc-ac24-833d7ad52976 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:53.908448 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ef9b590-025a-45fc-ac24-833d7ad52976 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:53.976845 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ef9b590-025a-45fc-ac24-833d7ad52976 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:53.984513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ef9b590-025a-45fc-ac24-833d7ad52976 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1088 microversion: 2.1 time: 0.080482 Jul 12 22:13:53.985122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 430/851] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:53 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:54.745040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:54.745569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:54.752083 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:54.752535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:54.753348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:54.754218 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:54.913191 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:54.929986 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-18cb2228-b296-4570-8eac-aa445b6921e1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.188882 Jul 12 22:13:54.931248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 422/852] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:54 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:55.009538 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:55.010771 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:55.019300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:55.019849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:55.020703 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:55.021344 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:55.097872 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:55.105495 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-38822f85-2ac6-4ca5-8cb6-e7853ec29659 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1204 microversion: 2.1 time: 0.099667 Jul 12 22:13:55.106256 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 431/853] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:55 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:55.949480 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:55.950015 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:55.956504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:55.957417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:55.958203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:55.958635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:56.104376 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:56.114971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0177b95c-b430-4cf1-ad5f-89cc911bd10b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.169203 Jul 12 22:13:56.115721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 423/854] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:55 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:56.127033 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:56.127829 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:56.142587 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:56.144580 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:56.145948 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:56.146630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:56.357291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:56.368394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e9d8425e-782b-40a4-9125-18099e259ead tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.248141 Jul 12 22:13:56.368980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 432/855] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:56 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:56.429199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-461259b0-8d32-4272-af04-7c9e2e0291a4 req-0450030b-4c78-46e4-b9a4-9bbf0431f62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:13:56.438382 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-461259b0-8d32-4272-af04-7c9e2e0291a4 req-0450030b-4c78-46e4-b9a4-9bbf0431f62b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:56.438827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-461259b0-8d32-4272-af04-7c9e2e0291a4 req-0450030b-4c78-46e4-b9a4-9bbf0431f62b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:56.451296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-461259b0-8d32-4272-af04-7c9e2e0291a4 req-0450030b-4c78-46e4-b9a4-9bbf0431f62b service nova] Creating event network-changed:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:13:56.457855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-461259b0-8d32-4272-af04-7c9e2e0291a4 req-0450030b-4c78-46e4-b9a4-9bbf0431f62b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032235 Jul 12 22:13:56.458484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 424/856] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:13:57.133620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:57.134260 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:57.141420 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:57.141988 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:57.142645 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:57.143164 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:57.390285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:57.391016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:57.397819 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:57.398272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:57.399053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:57.399491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:57.538587 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:57.546939 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e6c3a5b6-0503-4ada-82f1-99787dac7d41 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.164655 Jul 12 22:13:57.547852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 425/857] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:57 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:13:57.617943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:57.626497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-afbba6cc-dbcf-45ba-94ad-07a4615ad5da tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.496705 Jul 12 22:13:57.627058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 433/858] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:57 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:58.564500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:58.565089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:58.571814 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:58.572265 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:58.573058 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:58.573514 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:58.647961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:58.649349 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:58.656640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:58.657120 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:58.657901 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:58.658339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:58.717093 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:58.725087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-aecf8df6-b084-40cf-bc78-6dcf5e742542 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.164286 Jul 12 22:13:58.725732 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 426/859] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:58 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:58.796346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:58.804513 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1462fee9-1ba5-4a85-bbda-ed5bd253809a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.163181 Jul 12 22:13:58.805119 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 434/860] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:58 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:59.741853 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:59.742485 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:59.749028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:59.749468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:59.750250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:59.750675 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:59.831693 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:13:59.832318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:13:59.839193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:59.839727 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:59.841344 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:13:59.841852 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:13:59.888519 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:59.896263 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-765b2db9-24fa-47ad-9e25-d24e97eea3e7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.158160 Jul 12 22:13:59.897105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 427/861] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:59 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:13:59.981929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:13:59.989944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-70efa5b3-d9f3-467f-bbcd-3da1f82a1026 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.162390 Jul 12 22:13:59.990516 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 435/862] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:13:59 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:14:00.914274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:00.914822 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:00.923423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:00.923873 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:00.924700 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:00.925190 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:01.006922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:01.007539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:01.014339 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:01.014788 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:01.015562 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:01.015998 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:01.060155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:01.067804 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-65dc7d0f-d225-43a2-8004-e12123904d95 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.157180 Jul 12 22:14:01.068380 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 428/863] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:00 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:01.149664 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:01.158293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a44a98d6-0d27-490d-afac-d68cec4c684e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.155241 Jul 12 22:14:01.158843 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 436/864] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:01 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:14:02.084474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:02.085115 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:02.091776 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:02.092229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:02.093033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:02.093468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:02.175401 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:02.176013 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:02.182712 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:02.183154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:02.184579 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:02.185039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:02.227418 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:02.235628 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c99b476c-9b27-4ee5-a2ee-2a4b64b7ea07 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.154965 Jul 12 22:14:02.236205 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 429/865] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:02 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:02.320381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:02.328326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4484c753-234c-4c4f-ab46-39e12bff852d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1723 microversion: 2.1 time: 0.156953 Jul 12 22:14:02.328912 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 437/866] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:02 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:14:03.252733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:03.253330 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:03.259789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.260235 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.261028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.262114 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.344769 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:03.345411 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:03.352092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.352536 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.353327 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.353763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.396936 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:03.404677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-21c0fef8-5874-4aec-ac8a-076fa884b676 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.155905 Jul 12 22:14:03.405535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 430/867] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:03 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:03.488779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:03.497427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e5b8a19-fb0f-40d7-b064-51aa3182e9c1 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1700 microversion: 2.1 time: 0.156508 Jul 12 22:14:03.498007 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 438/868] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:03 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:03.513603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4ffccccf-3e48-4cd6-961c-c1ccb04ee4ea tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:14:03.519681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ffccccf-3e48-4cd6-961c-c1ccb04ee4ea tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.520127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4ffccccf-3e48-4cd6-961c-c1ccb04ee4ea tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.580414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4ffccccf-3e48-4cd6-961c-c1ccb04ee4ea tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Going to try to start instance {{(pid=117937) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 22:14:03.623226 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4ffccccf-3e48-4cd6-961c-c1ccb04ee4ea tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action" status: 202 len: 0 microversion: 2.1 time: 0.113248 Jul 12 22:14:03.623869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 431/869] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:14:03 2022] POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:14:03.632494 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:03.633146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:03.640589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.641061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.642060 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:03.643359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:03.805417 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:03.814061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7c7b750-2556-4b00-b910-c17c59b3c9c6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1709 microversion: 2.1 time: 0.185319 Jul 12 22:14:03.814639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 439/870] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:03 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:04.419174 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:04.419859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:04.424491 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:04.425221 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:04.432318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:04.432794 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:04.434184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:04.434617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:04.576092 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:04.583612 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c1e75b1d-93ef-4b7d-b803-23f9225ac7e2 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.166032 Jul 12 22:14:04.584177 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 432/871] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:04 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:04.832628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:04.833267 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:04.835109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:04.841799 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:04.842241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:04.843066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:04.843474 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:04.978884 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:04.988728 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-30e6465a-25ed-4831-a508-36ef8863dc52 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1709 microversion: 2.1 time: 0.159812 Jul 12 22:14:04.989241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 440/872] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:04 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:05.600939 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:05.601583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:05.608197 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:05.608579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:05.609377 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:05.609811 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:05.738890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:05.747552 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-21252122-5635-4534-a4ac-c3df7744026e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.150183 Jul 12 22:14:05.748128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 433/873] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:05 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:06.006180 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:06.006794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:06.013722 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:06.014174 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:06.014940 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:06.015379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:06.148985 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:06.163350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c4274f0c-7ed3-401a-b20e-d7ed07f0727f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1713 microversion: 2.1 time: 0.159903 Jul 12 22:14:06.163350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 441/874] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:06 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:06.764168 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:06.764940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:06.771977 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:06.772428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:06.773458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:06.774431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:06.779765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:06.809760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8bf6b709-7401-4a69-9125-116b3e2acf4f req-81e2cff8-02e9-43bf-befe-a97676988a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "name": "network-vif-plugged", "status": "completed", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:14:06.819108 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8bf6b709-7401-4a69-9125-116b3e2acf4f req-81e2cff8-02e9-43bf-befe-a97676988a84 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:06.819704 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8bf6b709-7401-4a69-9125-116b3e2acf4f req-81e2cff8-02e9-43bf-befe-a97676988a84 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:06.835619 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8bf6b709-7401-4a69-9125-116b3e2acf4f req-81e2cff8-02e9-43bf-befe-a97676988a84 service nova] Creating event network-vif-plugged:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:14:06.841911 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8bf6b709-7401-4a69-9125-116b3e2acf4f req-81e2cff8-02e9-43bf-befe-a97676988a84 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036732 Jul 12 22:14:06.842537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 442/875] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:14:06.926155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:06.934527 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-70ebddae-cc38-48aa-b183-7a1fdb99bf53 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.174876 Jul 12 22:14:06.935119 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 434/876] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:06 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:07.952845 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:07.953539 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:07.960500 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:07.960982 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:07.966624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:07.966624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:08.102438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:08.110663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a90d118b-96c0-42b2-be19-bbe5c553787c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1260 microversion: 2.1 time: 0.162469 Jul 12 22:14:08.111241 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 443/877] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:07 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:09.127433 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:09.128038 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:09.134562 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:09.135006 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:09.135755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:09.136183 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:09.271230 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:09.279469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-988ae484-1453-4b42-8566-26b89598fcd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1445 microversion: 2.1 time: 0.155836 Jul 12 22:14:09.280037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 435/878] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:09 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:09.295777 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:09.296384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:09.302938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:09.303381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:09.304140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:09.304568 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:09.319574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:09.435127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:09.442855 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6f8195a-36d4-4e9a-87cd-a63409c00667 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1445 microversion: 2.1 time: 0.151181 Jul 12 22:14:09.443418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 444/879] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:09 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:11.177567 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-0121f70e-28e8-49ea-8984-887978e317f0 req-3b14f9ff-6d02-48c8-8e3b-bc5fbb040bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:14:11.186631 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-0121f70e-28e8-49ea-8984-887978e317f0 req-3b14f9ff-6d02-48c8-8e3b-bc5fbb040bba service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:11.187090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-0121f70e-28e8-49ea-8984-887978e317f0 req-3b14f9ff-6d02-48c8-8e3b-bc5fbb040bba service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:11.198194 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-0121f70e-28e8-49ea-8984-887978e317f0 req-3b14f9ff-6d02-48c8-8e3b-bc5fbb040bba service nova] Creating event network-changed:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:14:11.204277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-0121f70e-28e8-49ea-8984-887978e317f0 req-3b14f9ff-6d02-48c8-8e3b-bc5fbb040bba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029914 Jul 12 22:14:11.204922 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 436/880] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:14:17.144201 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:14:17.144789 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:14:23.277569 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:14:23.278116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Tue Jul 12 22:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:14:39.509914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:39.510648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:39.513124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=39 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:39.513770 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:39.519347 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:39.519792 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:39.520584 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:39.521035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:39.606871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lazy-loading 'services' on Instance uuid 1ebe3a3a-5736-4df3-a820-a400fb366508 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:14:39.677927 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1bea47e4-58ef-4eea-a1c1-e3eef59ac7ed tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments/a2583374-2056-4e78-974e-e73f5933310a" status: 202 len: 0 microversion: 2.1 time: 0.171903 Jul 12 22:14:39.678694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 445/881] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:14:39 2022] DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments/a2583374-2056-4e78-974e-e73f5933310a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:14:40.791815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6bdd25b9-4875-4788-8abd-00b8cb9fe3d7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:14:40.794611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:40.795346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=12 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:14:40.801728 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6bdd25b9-4875-4788-8abd-00b8cb9fe3d7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:40.802932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6bdd25b9-4875-4788-8abd-00b8cb9fe3d7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:40.825391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6bdd25b9-4875-4788-8abd-00b8cb9fe3d7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Going to try to stop instance {{(pid=117937) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 22:14:40.871916 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6bdd25b9-4875-4788-8abd-00b8cb9fe3d7 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action" status: 202 len: 0 microversion: 2.1 time: 0.083895 Jul 12 22:14:40.872520 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 437/882] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:14:40 2022] POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:14:40.881496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:40.882205 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:40.890236 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:40.891244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:40.892545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:40.893015 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:41.041620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:41.053359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d095004b-9d69-4678-b9c1-1445792aad1f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.175998 Jul 12 22:14:41.053868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 446/883] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:40 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:42.076175 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:42.076905 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:42.083097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:42.083547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:42.084312 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:42.084791 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:42.214733 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:42.222813 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e69b9256-3521-4bb5-bb12-301bc3fa6274 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.152135 Jul 12 22:14:42.223312 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 438/884] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:42 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:43.239542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:43.240090 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:43.246638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:43.247086 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:43.247855 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:43.248296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:43.393711 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:43.401297 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00d84ba7-2221-4dce-9b50-275b8b275efd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.165782 Jul 12 22:14:43.402530 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 447/885] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:43 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:44.420906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:44.421963 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:44.431642 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:44.432328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:44.433547 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:44.434210 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:44.568610 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:44.576523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-fea5349c-72bd-43b7-b905-88b7e4d50ac9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.160656 Jul 12 22:14:44.577066 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 439/886] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:44 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:45.593573 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:45.594158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:45.600582 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:45.601044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:45.601790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:45.602215 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:45.731319 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:45.738843 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e200465-5381-45c3-97a3-f2bb615615bd tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.149192 Jul 12 22:14:45.739401 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 448/887] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:45 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:46.756655 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:46.757290 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:46.764913 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:46.765370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:46.766149 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:46.766582 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:46.908068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:46.915712 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-e44fe3a6-f865-4746-8a76-9f99ba94d976 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.163029 Jul 12 22:14:46.916280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 440/888] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:46 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:47.933879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:47.934490 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:47.941426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:47.941887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:47.942917 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:47.943351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:48.078109 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:48.086226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9d133a37-630e-4d5f-90ee-2ca891a16a67 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.156582 Jul 12 22:14:48.086781 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 449/889] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:47 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:49.102372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:49.102997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:49.110028 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:49.110525 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:49.111387 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:49.111823 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:49.239531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:49.247557 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ac07dac8-20cc-4118-97da-6bf21b7fe5b4 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.149027 Jul 12 22:14:49.248122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 441/890] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:49 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:50.265022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:50.265638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:50.272301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:50.272780 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:50.273540 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:50.273976 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:50.402670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:50.410163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-21bede6c-8a01-42e7-9c30-d35f62cbbbe5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1677 microversion: 2.1 time: 0.149119 Jul 12 22:14:50.410725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 450/891] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:50 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:51.427269 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:51.427870 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:51.434578 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:51.435019 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:51.435769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:51.436195 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:51.568993 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:51.577300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a55dfea8-cb87-44e2-9a7c-4bf7ae0e46a6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1654 microversion: 2.1 time: 0.153821 Jul 12 22:14:51.577869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 442/892] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:51 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:51.594353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-31bc9474-1cfd-498a-82fe-f41ac7254a86 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:14:51.600954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31bc9474-1cfd-498a-82fe-f41ac7254a86 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:51.601406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-31bc9474-1cfd-498a-82fe-f41ac7254a86 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:51.623163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-31bc9474-1cfd-498a-82fe-f41ac7254a86 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Going to try to start instance {{(pid=117938) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 22:14:51.667886 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-31bc9474-1cfd-498a-82fe-f41ac7254a86 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action" status: 202 len: 0 microversion: 2.1 time: 0.077356 Jul 12 22:14:51.668489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 451/893] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:14:51 2022] POST /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:14:51.676845 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:51.677507 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:51.683755 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:51.684286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:51.685088 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:51.685581 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:51.972571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:51.981198 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2c0365d6-3afa-4fef-8252-68172eaecb81 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1663 microversion: 2.1 time: 0.308091 Jul 12 22:14:51.981917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 443/894] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:51 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1663 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:52.999103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:52.999804 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:53.006480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:53.006930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:53.007699 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:53.008144 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:53.143675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:53.151203 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe744abc-3c00-46b8-817b-da050da62b3f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1663 microversion: 2.1 time: 0.157048 Jul 12 22:14:53.151803 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 452/895] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:52 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:14:54.169677 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:14:54.170233 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:14:54.176623 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:54.177103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:54.177858 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:14:54.178289 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:14:54.319818 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:14:54.327932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-522e87d2-8cfa-471a-840e-ada261ad7801 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1667 microversion: 2.1 time: 0.162744 Jul 12 22:14:54.328484 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 444/896] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:14:54 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:19.842560 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-580602922", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1581295142", "security_groups": [{"name": "tempest-secgroup-smoke-1104170630"}], "block_device_mapping_v2": [{"uuid": "cbb90700-06dc-4e4a-955a-59d3926e1910", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "246c2727-fc8d-41fb-b4a0-57699ab0459c"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:19.851092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=16 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:19.851751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:19.962211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] validate_networks() for [('246c2727-fc8d-41fb-b4a0-57699ab0459c', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:15:20.371578 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:15:20.372000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:15:20.372475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:15:20.372930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:15:20.373343 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:15:20.382222 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:20.382675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:20.383478 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:20.383917 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:20.401117 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:15:20.405945 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Getting quotas for user 24a41c09f2e4487f9897c9888a0d752f and project 80e867d86756459f9e4f53a4238d393d. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:15:20.462628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:15:20.465326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbb90700-06dc-4e4a-955a-59d3926e1910',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:15:20.592597 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-858b2aab-db1f-449c-a782-38d3574fbf65 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754106 Jul 12 22:15:20.593311 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 453/897] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:15:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:15:20.603210 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5cf27950-0cf4-4b33-a8a1-72df5580eba1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:20.603906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5cf27950-0cf4-4b33-a8a1-72df5580eba1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:20.606942 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=16 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:20.607674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:20.663822 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5cf27950-0cf4-4b33-a8a1-72df5580eba1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:20.671012 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5cf27950-0cf4-4b33-a8a1-72df5580eba1 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1094 microversion: 2.1 time: 0.071635 Jul 12 22:15:20.671572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 445/898] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:20 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:21.687809 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:21.689116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:21.696681 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:21.697470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:21.698754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:21.699194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:21.765904 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:21.773312 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-be85f308-3c3b-4a43-8864-c41e4779bf29 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1210 microversion: 2.1 time: 0.089584 Jul 12 22:15:21.773875 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 454/899] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:21 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:22.793345 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:22.793971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:22.800252 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:22.800731 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:22.801504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:22.801951 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:22.931735 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-d5076054-a54a-47b7-b4a2-495ef9a33383 req-993b01c2-d7ed-49d6-be4d-9f1033e77e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa130da8-ce09-4ff3-b08a-bfbf1abba310", "tag": "191cd60a-9fa7-4323-a105-c395e5b0bf4f"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:22.962887 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:22.976226 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d5076054-a54a-47b7-b4a2-495ef9a33383 req-993b01c2-d7ed-49d6-be4d-9f1033e77e82 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:22.977099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d5076054-a54a-47b7-b4a2-495ef9a33383 req-993b01c2-d7ed-49d6-be4d-9f1033e77e82 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:22.986519 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-88f021b6-cc1e-47cc-a67a-5f4a4e7245a0 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.188699 Jul 12 22:15:22.988575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 446/900] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:22 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:22.990302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-d5076054-a54a-47b7-b4a2-495ef9a33383 req-993b01c2-d7ed-49d6-be4d-9f1033e77e82 service nova] Creating event network-changed:191cd60a-9fa7-4323-a105-c395e5b0bf4f for instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 on hv-cinder-80295 Jul 12 22:15:22.997832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-d5076054-a54a-47b7-b4a2-495ef9a33383 req-993b01c2-d7ed-49d6-be4d-9f1033e77e82 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072302 Jul 12 22:15:22.998981 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 455/901] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:24.005558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:24.006371 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:24.013049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:24.013500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:24.014272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:24.014707 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:24.152818 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:24.160330 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-48b5efda-95e2-4143-b234-dcd7ac6f8b8f tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.158686 Jul 12 22:15:24.160957 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 447/902] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:24 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:25.178269 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:25.178972 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:25.186424 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:25.186870 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:25.187640 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:25.188080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:25.317136 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:25.325501 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-92475be3-c0e9-4ba3-b7e7-f8de817ed404 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.151457 Jul 12 22:15:25.326068 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 456/903] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:25 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:26.343013 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:26.343611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:26.350302 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:26.350749 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:26.351515 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:26.351949 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:26.481959 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:26.489413 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-72aee654-6236-4a95-bb1f-a79344326416 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.150808 Jul 12 22:15:26.489976 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 448/904] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:26 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:27.299202 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:27.300132 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:27.306713 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.307163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.308457 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.308934 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.337648 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-81c6f28d-6819-4775-a3a4-8ded7f0b9cdb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042348 Jul 12 22:15:27.338195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 457/905] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:15:27 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 22:15:27.394949 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:27.395500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:27.401989 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.402441 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.403209 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.403647 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.429009 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:15:27.507040 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:27.507688 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:27.508815 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-43d889ac-604c-4614-b1bb-c4f5d6b98876 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 204 len: 0 microversion: 2.1 time: 0.117239 Jul 12 22:15:27.509486 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 449/906] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:15:27 2022] DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:15:27.515021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.515631 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.516402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.516859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.519566 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:27.520299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:27.527204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.527204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.527920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:27.528365 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:27.661752 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:27.663023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:27.669996 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd5b6f5c-8c37-4188-ae83-2a9a2d5467d8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.167078 Jul 12 22:15:27.670558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 458/907] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:27 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:15:27.671189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9bcf5cb2-83be-4b8d-9517-e6b6cf9813f5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1673 microversion: 2.1 time: 0.156081 Jul 12 22:15:27.671862 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 450/908] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:27 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:28.687978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:28.688516 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:28.688745 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:28.689359 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:28.696087 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:28.696275 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:28.696522 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:28.696636 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:28.697326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:28.697447 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:28.697751 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:28.697952 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:28.830415 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:28.834094 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:28.839064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-61ae8388-6c6f-45a1-bfc6-b38f7ca6377e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1673 microversion: 2.1 time: 0.152970 Jul 12 22:15:28.839641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 451/909] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:28 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:15:28.842251 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3554bcd1-887b-4233-99ff-1981384a814e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.158542 Jul 12 22:15:28.842812 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 459/910] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:28 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:29.857102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:29.857958 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:29.860868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:29.861816 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:29.864606 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:29.865117 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:29.865917 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:29.866356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:29.871821 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:29.872288 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:29.873127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:29.873570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:30.010054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:30.020217 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-da6ede34-9366-4f39-aa0e-c09ddaf16a4a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1673 microversion: 2.1 time: 0.166785 Jul 12 22:15:30.029367 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 452/911] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:29 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:30.247408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:30.254916 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dec4fd0c-71c9-4c0d-ad64-01f3b49c16fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.399275 Jul 12 22:15:30.255479 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 460/912] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:29 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:31.037469 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:31.038254 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:31.042891 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:31.050186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:31.050995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:31.051860 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:31.052370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:31.055326 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-de069d7d-2bc6-4e18-acfc-ad019b11cab2 req-166352cd-2ee4-4b2b-8bde-647c77aab660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebe3a3a-5736-4df3-a820-a400fb366508", "name": "network-vif-deleted", "tag": "439fc499-dc30-4f59-b951-7832ab8a480e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:31.063510 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:31.063781 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:31.066574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-de069d7d-2bc6-4e18-acfc-ad019b11cab2 req-166352cd-2ee4-4b2b-8bde-647c77aab660 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:31.067445 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-de069d7d-2bc6-4e18-acfc-ad019b11cab2 req-166352cd-2ee4-4b2b-8bde-647c77aab660 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:31.081662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-de069d7d-2bc6-4e18-acfc-ad019b11cab2 req-166352cd-2ee4-4b2b-8bde-647c77aab660 service nova] Creating event network-vif-deleted:439fc499-dc30-4f59-b951-7832ab8a480e for instance 1ebe3a3a-5736-4df3-a820-a400fb366508 on hv-cinder-80295 Jul 12 22:15:31.087749 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-de069d7d-2bc6-4e18-acfc-ad019b11cab2 req-166352cd-2ee4-4b2b-8bde-647c77aab660 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035908 Jul 12 22:15:31.088667 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 461/913] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:15:31.161034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:31.175759 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ff083ffc-1edc-4d98-a290-d1861c6f13f9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 200 len: 1605 microversion: 2.1 time: 0.142153 Jul 12 22:15:31.176394 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 453/914] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:31 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 1605 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:31.272887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:31.273892 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:31.283218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:31.283982 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:31.285030 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:31.285718 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:31.433689 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:31.442271 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-155579a1-f0b8-4487-9bd2-9bdcf3a9e372 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.173688 Jul 12 22:15:31.442837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 462/915] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:31 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:32.193766 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:32.195074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:32.202053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:32.202604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:32.203468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:32.203916 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:32.218388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 HTTP/1.1 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:15:32.220062 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:15:32.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '1ebe3a3a-5736-4df3-a820-a400fb366508'} Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:15:32.222644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:15:32.223974 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:15:32.225267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:15:32.225267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ed2bdb87-146c-46e0-8946-bd4d075ce65f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 404 len: 111 microversion: 2.1 time: 0.031887 Jul 12 22:15:32.225267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 454/916] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:32 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:15:32.234781 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e03251b7-d534-416a-9399-976845a6f052 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '.version_select at 0x7f1b6f313700>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:32.254247 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e03251b7-d534-416a-9399-976845a6f052 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052048013" status: 202 len: 0 microversion: 2.1 time: 0.023283 Jul 12 22:15:32.254818 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 463/917] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jul 12 22:15:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052048013 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:15:32.460886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:32.461398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:32.468970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:32.469424 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:32.470200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:32.470888 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:32.733785 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:32.741533 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3f85eb06-aae5-4d4e-9254-6a6ee1a21961 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.285838 Jul 12 22:15:32.751021 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 455/918] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:32 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:33.023913 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-31533443-1b07-4178-ad7a-a56ca0ca645c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: .version_select at 0x7f1b6a93e820>, body: {"keypair": {"name": "tempest-keypair-432414766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDOyYiGJpIgazmYdhFn6wckckPxDL6FMoELgrkn2xPyCVBkQ+upRlpT3BjluB6AvOq8eFgHAQlozKT70OcQc/KRzis6HbfBj1MoeTvc+HtFNuBnEEYxQTxNFWrBP6hDNg=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:33.039298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-31533443-1b07-4178-ad7a-a56ca0ca645c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:15:33.044535 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-31533443-1b07-4178-ad7a-a56ca0ca645c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for user 2d0d387beaf842c3b5978210e504fbed and project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:15:33.068013 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-31533443-1b07-4178-ad7a-a56ca0ca645c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048107 Jul 12 22:15:33.068611 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 464/919] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:15:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:33.153305 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-ef575479-4b71-49e0-a12b-0c3557f0fdc8 req-36699cfe-6bba-49c9-8546-ae5f6fd0199b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa130da8-ce09-4ff3-b08a-bfbf1abba310", "name": "network-vif-plugged", "status": "completed", "tag": "191cd60a-9fa7-4323-a105-c395e5b0bf4f"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:33.163361 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ef575479-4b71-49e0-a12b-0c3557f0fdc8 req-36699cfe-6bba-49c9-8546-ae5f6fd0199b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:33.163881 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-ef575479-4b71-49e0-a12b-0c3557f0fdc8 req-36699cfe-6bba-49c9-8546-ae5f6fd0199b service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:33.178880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-ef575479-4b71-49e0-a12b-0c3557f0fdc8 req-36699cfe-6bba-49c9-8546-ae5f6fd0199b service nova] Creating event network-vif-plugged:191cd60a-9fa7-4323-a105-c395e5b0bf4f for instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 on hv-cinder-80295 Jul 12 22:15:33.184996 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-ef575479-4b71-49e0-a12b-0c3557f0fdc8 req-36699cfe-6bba-49c9-8546-ae5f6fd0199b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036972 Jul 12 22:15:33.185907 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 456/920] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:15:33.759646 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:33.760820 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:33.767596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:33.768039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:33.768848 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:33.769284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:33.907854 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:33.915655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4df337ef-d3ac-4001-ae64-f3131ed2ef4c tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1266 microversion: 2.1 time: 0.160489 Jul 12 22:15:33.916231 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 465/921] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:33 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:34.623025 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1897998289", "imageRef": "e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df24379e-7c0d-40d2-9b15-4897c7329299"}], "security_groups": [{"name": "tempest-securitygroup--685161720"}], "key_name": "tempest-keypair-432414766", "user_data": "}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:34.726180 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.network.neutron [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] validate_networks() for [('df24379e-7c0d-40d2-9b15-4897c7329299', None, None, None, None, None)] {{(pid=117937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:15:34.931707 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:34.932893 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:34.939181 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:34.939632 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:34.940410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:34.940922 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:35.077709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:35.085789 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a86e532f-ebc2-4f5d-8ed6-1ba753205d6b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1454 microversion: 2.1 time: 0.157854 Jul 12 22:15:35.086360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 466/922] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:34 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:15:35.101937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:35.102400 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Flavor limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:15:35.102537 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:35.102830 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Image limits 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:15:35.103308 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Flavor pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:15:35.103721 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Image pref 0:0:0 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:15:35.104157 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.virt.hardware [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:15:35.108738 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:35.109268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:35.110034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:35.110464 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:35.113146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:35.113599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:35.114411 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:35.114855 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:35.131523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:15:35.136033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Getting quotas for user 2d0d387beaf842c3b5978210e504fbed and project b80ca69f6cd7402cb644c7721015ebc8. Resources: {'ram', 'instances', 'cores'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:15:35.147285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Going to run 1 instances... {{(pid=117937) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:15:35.149624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d3c9c5-b9f7-47b5-a4d9-7d0d1d317ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:15:35.200442 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-308a93b1-e071-4c7c-b27f-4b0b6dd7801f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580426 Jul 12 22:15:35.201179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 457/923] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:15:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:15:35.211280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-296edad8-de32-4d49-b22c-b9092d812ca5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:35.211954 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-296edad8-de32-4d49-b22c-b9092d812ca5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:35.254601 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:35.263729 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-525af5d4-a323-4c9c-9a10-3b5509e1c413 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1454 microversion: 2.1 time: 0.165503 Jul 12 22:15:35.264310 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 467/924] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:35 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:15:35.274500 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-296edad8-de32-4d49-b22c-b9092d812ca5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:35.283851 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-296edad8-de32-4d49-b22c-b9092d812ca5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1237 microversion: 2.1 time: 0.076455 Jul 12 22:15:35.284692 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 458/925] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:35 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:36.303397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:36.303811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:36.312159 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:36.312676 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:36.313745 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:36.314268 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:36.430518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:36.438692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5170ba85-cb47-4aeb-9d4e-0ff02d69d36c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1295 microversion: 2.1 time: 0.140311 Jul 12 22:15:36.439363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 468/926] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:36 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:37.456926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:37.457656 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:37.465474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:37.466163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:37.467324 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:37.468871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:37.507377 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6e988684-a86d-40ae-ac12-90d3c6297205 req-cdc61f44-700a-47bd-969a-6d84de829caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa130da8-ce09-4ff3-b08a-bfbf1abba310", "tag": "191cd60a-9fa7-4323-a105-c395e5b0bf4f"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:37.519827 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6e988684-a86d-40ae-ac12-90d3c6297205 req-cdc61f44-700a-47bd-969a-6d84de829caf service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:37.523266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6e988684-a86d-40ae-ac12-90d3c6297205 req-cdc61f44-700a-47bd-969a-6d84de829caf service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:37.544039 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6e988684-a86d-40ae-ac12-90d3c6297205 req-cdc61f44-700a-47bd-969a-6d84de829caf service nova] Creating event network-changed:191cd60a-9fa7-4323-a105-c395e5b0bf4f for instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 on hv-cinder-80295 Jul 12 22:15:37.549709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6e988684-a86d-40ae-ac12-90d3c6297205 req-cdc61f44-700a-47bd-969a-6d84de829caf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053319 Jul 12 22:15:37.550444 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 469/927] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:37.669853 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:37.684906 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9ace3f2e-33e9-461e-82ec-c4b4580a59d3 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.231769 Jul 12 22:15:37.685709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 459/928] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:37 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:38.721760 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:38.722574 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:38.731289 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:38.731831 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:38.732700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:38.733926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:38.971242 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:38.980643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a89a1d49-bebc-4435-8472-6c5c44888baa tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.281297 Jul 12 22:15:38.981232 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 470/929] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:38 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:39.569091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-291d0eb1-2efe-4ae0-b00a-9b85cce61c73 req-8ff59a7c-ea47-496b-9cf7-a407999b0de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d669c681-2c5c-40c2-be20-1fdb735b93c4", "tag": "6219b251-5097-47d3-b0d4-3b92dc4c6165"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:39.579577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-291d0eb1-2efe-4ae0-b00a-9b85cce61c73 req-8ff59a7c-ea47-496b-9cf7-a407999b0de7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:39.579577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-291d0eb1-2efe-4ae0-b00a-9b85cce61c73 req-8ff59a7c-ea47-496b-9cf7-a407999b0de7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:39.593286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-291d0eb1-2efe-4ae0-b00a-9b85cce61c73 req-8ff59a7c-ea47-496b-9cf7-a407999b0de7 service nova] Creating event network-changed:6219b251-5097-47d3-b0d4-3b92dc4c6165 for instance d669c681-2c5c-40c2-be20-1fdb735b93c4 on hv-cinder-80295 Jul 12 22:15:39.598255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-291d0eb1-2efe-4ae0-b00a-9b85cce61c73 req-8ff59a7c-ea47-496b-9cf7-a407999b0de7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033210 Jul 12 22:15:39.598854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 460/930] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:39.999398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:40.001458 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:40.011016 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:40.011701 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:40.012961 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:40.013653 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:40.149345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:40.156793 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f80f5d64-b7b3-4b0f-a71f-f8a0301c9177 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.162835 Jul 12 22:15:40.157352 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 471/931] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:39 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:15:41.175490 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:41.176277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:41.182621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:41.183071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:41.183843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:41.184277 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:41.323627 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:41.331123 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3e5bce96-e805-426f-9359-cef58b72246c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.160304 Jul 12 22:15:41.331685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 461/932] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:41 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:42.348629 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:42.349277 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:42.356982 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:42.357459 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:42.358272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:42.358716 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:42.576423 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:42.583937 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3c8cab5d-f9d2-4640-b865-2f86521f929e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.239302 Jul 12 22:15:42.584499 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 472/933] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:42 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:43.216474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-e8711441-30e2-431c-9af7-5ed76a5617aa req-86b2bbb8-a9ee-4347-b681-0df017763c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d669c681-2c5c-40c2-be20-1fdb735b93c4", "name": "network-vif-plugged", "status": "completed", "tag": "6219b251-5097-47d3-b0d4-3b92dc4c6165"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:43.225362 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e8711441-30e2-431c-9af7-5ed76a5617aa req-86b2bbb8-a9ee-4347-b681-0df017763c08 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:43.225834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-e8711441-30e2-431c-9af7-5ed76a5617aa req-86b2bbb8-a9ee-4347-b681-0df017763c08 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:43.237772 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-e8711441-30e2-431c-9af7-5ed76a5617aa req-86b2bbb8-a9ee-4347-b681-0df017763c08 service nova] Creating event network-vif-plugged:6219b251-5097-47d3-b0d4-3b92dc4c6165 for instance d669c681-2c5c-40c2-be20-1fdb735b93c4 on hv-cinder-80295 Jul 12 22:15:43.242588 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-e8711441-30e2-431c-9af7-5ed76a5617aa req-86b2bbb8-a9ee-4347-b681-0df017763c08 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030578 Jul 12 22:15:43.243366 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 462/934] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:43.601272 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:43.601865 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:43.603868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:43.609974 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:43.610416 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:43.611175 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:43.611607 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:43.742858 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:43.750833 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d3c058e6-1af3-4023-9299-5835155268d5 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.153408 Jul 12 22:15:43.751398 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 473/935] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:43 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:44.769065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:44.769780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:44.777443 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:44.777886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:44.778644 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:44.779071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:44.967404 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:44.979711 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b2a33a52-8528-485c-b94b-e4d9aff2e484 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1362 microversion: 2.1 time: 0.214439 Jul 12 22:15:44.980702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 463/936] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:44 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:46.000192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:46.000820 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:46.007360 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:46.007805 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:46.008557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:46.009017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:46.013496 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:46.138980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:15:46.146298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b81d763c-bc68-454d-9302-449d000806fc tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1547 microversion: 2.1 time: 0.149930 Jul 12 22:15:46.146851 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 474/937] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:15:45 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:15:46.162641 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:15:46.163151 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:15:46.165070 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:46.165750 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=8 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:15:46.172729 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:46.173173 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:46.173939 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:46.174368 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:46.251946 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f5fdc961-ad23-4990-9bd0-d41a381ff8d8 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093054 Jul 12 22:15:46.252535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 464/938] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jul 12 22:15:46 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:15:47.203263 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5dbd7899-d356-4180-beb4-237f5998e62c req-b2623380-3d70-4752-be1b-62bd200f25f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d669c681-2c5c-40c2-be20-1fdb735b93c4", "tag": "6219b251-5097-47d3-b0d4-3b92dc4c6165"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:15:47.213236 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5dbd7899-d356-4180-beb4-237f5998e62c req-b2623380-3d70-4752-be1b-62bd200f25f7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:15:47.213654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5dbd7899-d356-4180-beb4-237f5998e62c req-b2623380-3d70-4752-be1b-62bd200f25f7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:15:47.229838 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5dbd7899-d356-4180-beb4-237f5998e62c req-b2623380-3d70-4752-be1b-62bd200f25f7 service nova] Creating event network-changed:6219b251-5097-47d3-b0d4-3b92dc4c6165 for instance d669c681-2c5c-40c2-be20-1fdb735b93c4 on hv-cinder-80295 Jul 12 22:15:47.234989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5dbd7899-d356-4180-beb4-237f5998e62c req-b2623380-3d70-4752-be1b-62bd200f25f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035382 Jul 12 22:15:47.235930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 475/939] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:08.223911 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:08.224702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:08.229354 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:08.230102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:08.238981 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:08.239437 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:08.240204 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:08.240638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:08.268232 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.objects.instance [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lazy-loading 'flavor' on Instance uuid e54bd1b3-a4f2-461f-a74c-340e7184c1f3 {{(pid=117937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:16:08.341577 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-96faef67-9bd2-4d09-9921-2df75e71e59d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "POST /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.118763 Jul 12 22:16:08.342192 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 465/940] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:16:08 2022] POST /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:16:08.351479 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:08.352832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:08.359399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:08.360642 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:08.363726 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:08.363859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:08.365201 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:08.366118 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:08.506756 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:08.514941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2fd49448-9d71-493b-bfb4-edf16e8c6633 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.167736 Jul 12 22:16:08.515497 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 476/941] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:08 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:09.532990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:09.533685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:09.540105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:09.540556 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:09.541345 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:09.541781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:09.675385 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:09.683065 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2d7bd87c-16d2-430b-8631-98aebc536fd6 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.154776 Jul 12 22:16:09.683725 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 466/942] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:09 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:10.701046 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:10.701651 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:10.708248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:10.708683 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:10.709468 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:10.709893 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:10.850606 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:10.858224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-82d51a5b-6e3c-446a-85ea-59f6cd7f2827 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.161843 Jul 12 22:16:10.858778 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 477/943] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:10 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:11.875829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:11.876440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:11.883004 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:11.883483 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:11.884260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:11.884692 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:12.019559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:12.027966 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9f8e0e96-6e74-4c02-bf1a-0fbc6d4c6eef tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.155998 Jul 12 22:16:12.028621 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 467/944] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:11 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:13.045558 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:13.046149 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:13.052949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:13.053400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:13.054162 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:13.054593 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:13.189737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:13.197534 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e2d7634-8b34-425a-9357-84dff2f1636e tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.156577 Jul 12 22:16:13.198103 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 478/945] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:13 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:14.214030 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:14.214674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:14.221440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:14.221834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:14.222609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:14.223046 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:14.352910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:14.360383 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-592bbde5-6368-4da3-8b50-1ecf11d06b69 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.150413 Jul 12 22:16:14.360968 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 468/946] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:14 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:15.377695 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:15.378300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:15.384794 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:15.385242 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:15.385997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:15.386427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:15.516860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:15.524301 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13912c67-e100-4bb3-85a0-9a6fc169f446 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.150505 Jul 12 22:16:15.524878 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 479/947] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:15 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:16:16.540990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:16.541600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:16.548138 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:16.548574 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:16.549363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:16.549788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:16.681441 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:16.689548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-36080d14-355b-4d1f-8bf7-deac8ea6e842 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.152453 Jul 12 22:16:16.690120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 469/948] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:16 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:17.707126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:17.707740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:17.714218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:17.714666 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:17.715434 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:17.715879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:17.847219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:17.854792 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cbc0cc13-f41e-41f5-bdf3-ce2f1df39355 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.151498 Jul 12 22:16:17.855359 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 480/949] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:17 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:18.872425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:18.873071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:18.880101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:18.880474 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:18.881286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:18.881718 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:19.017356 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:19.025253 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-40b04abd-dcde-444a-84c4-bdc02044f624 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.156597 Jul 12 22:16:19.026156 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 470/950] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:18 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:20.043131 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:20.043943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:20.050841 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:20.051293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:20.052058 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:20.052556 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:20.191999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:20.199626 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-29f78804-b6d4-4b1c-bdab-10e30506b16d tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.160313 Jul 12 22:16:20.200189 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 481/951] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:20 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:21.216680 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:21.217256 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:21.224148 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.224603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.225416 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.225852 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.357696 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:21.365465 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eff76b10-6527-4189-b1a8-3c35534e00df tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1571 microversion: 2.1 time: 0.152819 Jul 12 22:16:21.366068 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 471/952] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:21 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:21.382083 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:21.382662 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:21.389959 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.390489 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.391556 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.392012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.471594 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f40333c6-e855-4d66-9d47-4304124c065c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "POST /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.093122 Jul 12 22:16:21.472113 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 482/953] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:16:21 2022] POST /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:16:21.480063 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:21.480964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:21.488129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.488523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.489376 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:21.489832 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:21.627683 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:21.635212 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-32da3869-d87b-469b-b120-2253de19ef32 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1519 microversion: 2.1 time: 0.159013 Jul 12 22:16:21.635774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 472/954] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:21 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:22.652500 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:22.653068 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:22.661322 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:22.661776 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:22.662554 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:22.662989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:22.801583 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:22.809154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-39e4226a-2ce4-432e-92a2-a78d42bb3a2a tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1521 microversion: 2.1 time: 0.160758 Jul 12 22:16:22.810350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 483/955] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:22 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:23.247921 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:23.248453 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:23.255188 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:23.255638 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:23.256412 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:23.256869 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:23.281724 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ed05aa7b-cd62-4a32-bb46-2e2b9a627f5a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/ips" status: 200 len: 144 microversion: 2.1 time: 0.037861 Jul 12 22:16:23.282300 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 473/956] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jul 12 22:16:23 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:23.427680 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-c84f07bc-e9ad-4d42-884a-a5a5de32e84a req-66191d89-50da-4a1c-b4d8-b12c13cefc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "name": "network-vif-unplugged", "status": "completed", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:23.442618 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-c84f07bc-e9ad-4d42-884a-a5a5de32e84a req-66191d89-50da-4a1c-b4d8-b12c13cefc6a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:23.443391 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-c84f07bc-e9ad-4d42-884a-a5a5de32e84a req-66191d89-50da-4a1c-b4d8-b12c13cefc6a service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:23.457481 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-c84f07bc-e9ad-4d42-884a-a5a5de32e84a req-66191d89-50da-4a1c-b4d8-b12c13cefc6a service nova] Creating event network-vif-unplugged:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:16:23.462624 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-c84f07bc-e9ad-4d42-884a-a5a5de32e84a req-66191d89-50da-4a1c-b4d8-b12c13cefc6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039123 Jul 12 22:16:23.463224 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 484/957] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:16:23.827696 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:23.828310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:23.834439 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:23.834890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:23.835659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:23.836097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:23.976238 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:23.984740 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6db08087-f2f2-4331-8d3b-9e4c7653d3b0 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.161113 Jul 12 22:16:23.985334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 474/958] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:23 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:24.649891 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c64d245-7ee3-4ff7-b065-d6fd16c555c0"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:24.651071 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:24.657837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:24.658291 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:24.659062 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:24.659504 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:24.903019 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-77cdf624-9e03-4d3b-8559-f0a102509b55 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257132 Jul 12 22:16:24.903762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 485/959] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:16:24 2022] POST /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:25.001928 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:25.002548 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:25.009052 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:25.009501 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:25.010282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:25.010701 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:25.145842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:25.153425 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b8bbf6ca-7c77-4a69-ac87-ee01d1222cd4 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.155659 Jul 12 22:16:25.154064 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 475/960] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:24 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:26.170948 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:26.171660 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:26.178690 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:26.179146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:26.179965 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:26.180406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:26.312225 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:26.320163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-04633b57-f8f9-41c4-b48f-c1764cbf80d3 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.153415 Jul 12 22:16:26.320740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 486/961] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:26 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:27.337726 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:27.338343 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:27.345054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:27.345444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:27.346203 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:27.346647 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:27.477713 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:27.485632 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7e2e3e2b-244b-41e7-ab57-8367e1acbe2c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.151889 Jul 12 22:16:27.486185 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 476/962] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:27 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:28.503025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:28.503634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:28.510305 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:28.510755 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:28.511518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:28.511949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:28.647989 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:28.655639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e7cd6e62-2ee7-43f8-933c-60586b21d84f tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.156826 Jul 12 22:16:28.656232 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 487/963] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:28 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:29.671965 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:29.672635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:29.679868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:29.680318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:29.681120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:29.681559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:29.819387 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:29.827272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-271936fb-5ada-498e-a510-86930c91ab36 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.159230 Jul 12 22:16:29.827854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 477/964] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:29 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:30.846176 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:30.846807 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:30.853709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:30.854161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:30.854934 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:30.855371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:31.019466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:31.027364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1a25d669-be2d-447f-a119-23f1d37b38fe tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1577 microversion: 2.1 time: 0.186062 Jul 12 22:16:31.027921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 488/965] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:30 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:16:32.044450 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:32.045129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:32.052022 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.052477 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.053309 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.053752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.187775 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:32.196135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-db1bc606-077c-400c-8b9d-3c5d2ee44c48 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1564 microversion: 2.1 time: 0.155672 Jul 12 22:16:32.196702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 478/966] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:32 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:32.419967 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:32.421002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:32.428925 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.429409 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.430221 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.430661 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.461859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5273c343-48f5-4858-8dc7-97841ee94e04 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Jul 12 22:16:32.462421 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 489/967] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:16:32 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:32.472617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:32.473140 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:32.479059 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.479504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.480260 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:32.480687 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:32.507617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:32.512128 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-0a38b29b-e2a0-4c4f-990a-364cc484f98a tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0" status: 200 len: 194 microversion: 2.1 time: 0.043841 Jul 12 22:16:32.512727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 479/968] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jul 12 22:16:32 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:33.509944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-84422f85-ce3f-4b9b-9887-859098cc6783 req-8e6857a9-81df-4588-91cd-ee983fbe9463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "name": "network-vif-plugged", "status": "completed", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:33.519353 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-84422f85-ce3f-4b9b-9887-859098cc6783 req-8e6857a9-81df-4588-91cd-ee983fbe9463 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:33.519929 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-84422f85-ce3f-4b9b-9887-859098cc6783 req-8e6857a9-81df-4588-91cd-ee983fbe9463 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:33.532397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-84422f85-ce3f-4b9b-9887-859098cc6783 req-8e6857a9-81df-4588-91cd-ee983fbe9463 service nova] Creating event network-vif-plugged:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:16:33.539650 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-84422f85-ce3f-4b9b-9887-859098cc6783 req-8e6857a9-81df-4588-91cd-ee983fbe9463 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033218 Jul 12 22:16:33.540694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 490/969] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:33.852920 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc19b814-c172-49ea-b5ec-e5dbaeaa6b7a"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:33.853980 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:33.861476 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:33.861929 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:33.862709 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:33.863146 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:34.105101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5a61d978-4451-4d75-85a3-cfdf9d5fbe56 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "POST /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255912 Jul 12 22:16:34.105914 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 480/970] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:16:33 2022] POST /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:41.589934 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:41.590949 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:41.592905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=33 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:41.599426 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.599930 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.600828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.601296 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.605160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:41.644726 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-893e9723-d168-421b-a31d-5b5494a6c17f tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059698 Jul 12 22:16:41.645321 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 491/971] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:16:41 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:41.783466 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:41.784034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:41.786614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=33 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:16:41.792559 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.793097 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.794090 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.794655 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.825328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-8f36d464-0edf-490c-afd6-e54b96267f9e tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0" status: 200 len: 194 microversion: 2.1 time: 0.046715 Jul 12 22:16:41.825908 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 481/972] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jul 12 22:16:41 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:41.835679 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:41.836192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:41.842211 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.842654 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.843400 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:41.844309 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:41.924351 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lazy-loading 'services' on Instance uuid d669c681-2c5c-40c2-be20-1fdb735b93c4 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:16:41.998926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6001dacd-cd21-41e0-bff4-f5327c4bf404 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0" status: 202 len: 0 microversion: 2.1 time: 0.166984 Jul 12 22:16:41.999551 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 492/973] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:16:41 2022] DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/6c64d245-7ee3-4ff7-b065-d6fd16c555c0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:16:43.113237 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:43.113781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:43.120352 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:43.120836 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:43.121681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:43.122121 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:43.151186 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-966ffdd1-f232-4466-bb04-3e824dd0d40c tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/bc19b814-c172-49ea-b5ec-e5dbaeaa6b7a" status: 200 len: 194 microversion: 2.1 time: 0.042491 Jul 12 22:16:43.151768 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 482/974] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jul 12 22:16:43 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/bc19b814-c172-49ea-b5ec-e5dbaeaa6b7a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:43.162236 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:43.162825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:43.169687 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:43.170139 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:43.170907 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:43.171345 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:43.252635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lazy-loading 'services' on Instance uuid d669c681-2c5c-40c2-be20-1fdb735b93c4 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:16:43.324809 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e2786412-20ae-43c3-b26a-520b92607200 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/bc19b814-c172-49ea-b5ec-e5dbaeaa6b7a" status: 202 len: 0 microversion: 2.1 time: 0.166647 Jul 12 22:16:43.325464 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 493/975] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:16:43 2022] DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments/bc19b814-c172-49ea-b5ec-e5dbaeaa6b7a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:16:44.486835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:44.487827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:44.494296 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.494765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.495530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.495971 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.524555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c1ad591e-3d8f-4d6c-86e7-d74af0f9efb6 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042292 Jul 12 22:16:44.525135 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 483/976] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:16:44 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:16:44.633801 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:44.634887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:44.642128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.642521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.643297 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.643736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.672476 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d61d5c16-c569-42ce-a313-30c4f3017b08 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043090 Jul 12 22:16:44.673065 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 494/977] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:16:44 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:16:44.732077 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:44.732575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:44.739423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.739878 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.740661 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.741127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.766569 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Going to try to terminate instance {{(pid=117937) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:16:44.843310 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-f7da5ad3-8857-4b5d-84a9-c478e7af6928 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 204 len: 0 microversion: 2.1 time: 0.114676 Jul 12 22:16:44.844581 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 484/978] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:16:44 2022] DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:16:44.852751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:44.853386 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:44.859361 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.860470 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.861244 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:44.861673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:44.996429 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:45.004034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f7e0832b-05e8-4709-8874-4746a26a698b tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1671 microversion: 2.1 time: 0.155168 Jul 12 22:16:45.004595 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 495/979] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:44 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:16:46.022182 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:46.022864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:46.029258 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:46.029700 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:46.030478 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:46.030908 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:46.160023 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:46.167507 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6980789e-a711-4eaf-b7f9-6c718892af33 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1671 microversion: 2.1 time: 0.149565 Jul 12 22:16:46.168071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 485/980] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:46 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:47.185859 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:47.186477 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:47.198455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:47.198915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:47.199700 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:47.200184 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:47.561192 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d387beaf842c3b5978210e504fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80ca69f6cd7402cb644c7721015ebc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:16:47.570092 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e9b070b5-1126-470c-8852-70805f844639 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 200 len: 1604 microversion: 2.1 time: 0.388132 Jul 12 22:16:47.571408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 496/981] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:47 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 1604 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:16:47.829049 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-7c725cdb-b946-47fc-bf22-842adcc44fd0 req-3c458eb0-e82c-4fc3-97ce-1d635235a478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d669c681-2c5c-40c2-be20-1fdb735b93c4", "name": "network-vif-deleted", "tag": "6219b251-5097-47d3-b0d4-3b92dc4c6165"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:16:47.837534 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-7c725cdb-b946-47fc-bf22-842adcc44fd0 req-3c458eb0-e82c-4fc3-97ce-1d635235a478 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:47.838079 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-7c725cdb-b946-47fc-bf22-842adcc44fd0 req-3c458eb0-e82c-4fc3-97ce-1d635235a478 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:47.850837 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-7c725cdb-b946-47fc-bf22-842adcc44fd0 req-3c458eb0-e82c-4fc3-97ce-1d635235a478 service nova] Creating event network-vif-deleted:6219b251-5097-47d3-b0d4-3b92dc4c6165 for instance d669c681-2c5c-40c2-be20-1fdb735b93c4 on hv-cinder-80295 Jul 12 22:16:47.855504 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-7c725cdb-b946-47fc-bf22-842adcc44fd0 req-3c458eb0-e82c-4fc3-97ce-1d635235a478 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102688 Jul 12 22:16:47.856101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 486/982] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:16:48.587541 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:48.588158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:48.595418 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:48.595869 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:48.596641 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:48.597100 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:48.611543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 HTTP/1.1 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:16:48.613266 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:48.614994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'd669c681-2c5c-40c2-be20-1fdb735b93c4'} Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:16:48.615898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:48.617512 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:48.618864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:16:48.618864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-deda5ee5-78aa-4eba-85e9-4be2194c16d9 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 404 len: 111 microversion: 2.1 time: 0.031036 Jul 12 22:16:48.618864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 497/983] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:48 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:16:48.624441 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-bbb72468-0c2d-4dac-9787-93d43087671d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '.version_select at 0x7f1b669b8af0>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:48.649017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-bbb72468-0c2d-4dac-9787-93d43087671d tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-432414766" status: 202 len: 0 microversion: 2.1 time: 0.028551 Jul 12 22:16:48.649838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 487/984] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jul 12 22:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-432414766 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:16:51.544099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:51.544692 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:51.551238 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:51.551691 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:51.552461 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:51.552943 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:51.567246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 HTTP/1.1 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:16:51.568853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.570450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'd669c681-2c5c-40c2-be20-1fdb735b93c4'} Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:16:51.571374 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.572849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.574332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:16:51.574332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68ad7132-5ae9-414c-b08f-e6be00c51dbb tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 404 len: 111 microversion: 2.1 time: 0.030610 Jul 12 22:16:51.574332 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 498/985] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:16:51 2022] DELETE /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:16:51.580037 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:51.580799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: d669c681-2c5c-40c2-be20-1fdb735b93c4] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:51.587016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:51.587468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:51.588240 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:51.588679 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:51.602069 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 HTTP/1.1 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:16:51.603691 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.605372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'd669c681-2c5c-40c2-be20-1fdb735b93c4'} Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:16:51.606272 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. Jul 12 22:16:51.607964 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:51.609105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance d669c681-2c5c-40c2-be20-1fdb735b93c4 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:16:51.609105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-eb91e081-756b-444b-ab67-2bee74adcf13 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4" status: 404 len: 111 microversion: 2.1 time: 0.030195 Jul 12 22:16:51.609105 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 488/986] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:51 2022] GET /compute/v2.1/servers/d669c681-2c5c-40c2-be20-1fdb735b93c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:16:52.743668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:52.744165 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:52.750921 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:52.751350 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:52.752111 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:52.752543 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:52.766125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 HTTP/1.1 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:16:52.767705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.769335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '1ebe3a3a-5736-4df3-a820-a400fb366508'} Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:16:52.770250 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.771990 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.773740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:16:52.773740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0555e9d8-7fe5-40c5-8fae-12b0e02f9f95 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 404 len: 111 microversion: 2.1 time: 0.029187 Jul 12 22:16:52.773740 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 499/987] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:16:52 2022] DELETE /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:16:52.777403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:16:52.778014 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] [instance: 1ebe3a3a-5736-4df3-a820-a400fb366508] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:16:52.786144 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:52.786589 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:52.787359 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:16:52.787792 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:16:52.802575 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] HTTP exception thrown: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Request method failure captured: Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 HTTP/1.1 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfHQC9_HpUS6gpvynaI7co1MqZzHTuXC3w_N6k27TJNc_cMqHzIjJraFxAvKJWi3KUFoHNS37hnlbb-DMY4Quop4H3R0JMnOughDLhBYHHCVpwQ9PclESGd2yhnOUb9BSjMGA6K8qAJQEGXM3MBzeWBRNUelDD0vbRrPPpVj3eX8hY8 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:16:52.804103 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b80ca69f6cd7402cb644c7721015ebc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: b80ca69f6cd7402cb644c7721015ebc8 Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1316596378 Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 2d0d387beaf842c3b5978210e504fbed Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-AttachVolumeTestJSON-1316596378-project Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.805767 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '1ebe3a3a-5736-4df3-a820-a400fb366508'} Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:16:52.806669 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. Jul 12 22:16:52.808017 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:16:52.809351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] Returning 404 to user: Instance 1ebe3a3a-5736-4df3-a820-a400fb366508 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:16:52.809351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-40905d00-76d0-40db-8336-e0de8919ad64 tempest-AttachVolumeTestJSON-1316596378 tempest-AttachVolumeTestJSON-1316596378-project] 10.222.0.44 "GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508" status: 404 len: 111 microversion: 2.1 time: 0.031944 Jul 12 22:16:52.809351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 489/988] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:16:52 2022] GET /compute/v2.1/servers/1ebe3a3a-5736-4df3-a820-a400fb366508 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:17:05.976828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:05.977344 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:05.979172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-a3a10b62-109f-493d-bc22-711b92f07313 req-30e00772-0451-4719-a630-2425195e6b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa130da8-ce09-4ff3-b08a-bfbf1abba310", "tag": "191cd60a-9fa7-4323-a105-c395e5b0bf4f"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:05.979968 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=17 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:05.980887 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:05.985364 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:05.986979 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:05.989194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:05.989736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:05.990526 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:05.990970 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:05.994608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-a3a10b62-109f-493d-bc22-711b92f07313 req-30e00772-0451-4719-a630-2425195e6b06 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:05.995129 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-a3a10b62-109f-493d-bc22-711b92f07313 req-30e00772-0451-4719-a630-2425195e6b06 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:06.008537 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-a3a10b62-109f-493d-bc22-711b92f07313 req-30e00772-0451-4719-a630-2425195e6b06 service nova] Creating event network-changed:191cd60a-9fa7-4323-a105-c395e5b0bf4f for instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 on hv-cinder-80295 Jul 12 22:17:06.015334 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-a3a10b62-109f-493d-bc22-711b92f07313 req-30e00772-0451-4719-a630-2425195e6b06 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040006 Jul 12 22:17:06.016538 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 490/989] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:17:06.018899 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:17:06.107697 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6f224732-a9e3-489c-a52b-a49a1a14bb48 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 204 len: 0 microversion: 2.1 time: 0.134438 Jul 12 22:17:06.108222 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 500/990] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:17:05 2022] DELETE /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:17:06.117020 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:06.117719 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:06.125234 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:06.125676 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:06.126446 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:06.126932 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:06.259778 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:06.267953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-b2c6d510-52c9-4045-967c-7ccf39cac463 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1579 microversion: 2.1 time: 0.154520 Jul 12 22:17:06.268576 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 491/991] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:06 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:17:07.286348 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:07.287049 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:07.293545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:07.293994 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:07.294758 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:07.295195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:07.430968 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:07.438563 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8d19b46e-a9b4-475f-ac33-6ae545cfa0fe tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1579 microversion: 2.1 time: 0.157072 Jul 12 22:17:07.439173 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 501/992] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:07 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:08.455943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:08.456663 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:08.463179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:08.463635 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:08.464403 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:08.464880 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:08.599468 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:08.606975 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-2196b1f5-c1cf-4b7e-a4cb-e3f8c00db2f6 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1579 microversion: 2.1 time: 0.154956 Jul 12 22:17:08.607541 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 492/993] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:08 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:09.626466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:09.627064 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:09.634570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:09.635016 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:09.635779 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:09.636209 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:09.805193 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:09.813428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c3c62d9f-ab1f-4a19-8f18-f34b589b6e1b tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1579 microversion: 2.1 time: 0.191249 Jul 12 22:17:09.814148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 502/994] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:09 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1579 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:10.584044 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-07cd246d-0f02-4192-ad05-9e124cc269ec req-28e8032b-2c67-4001-840b-9fdf1066929e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa130da8-ce09-4ff3-b08a-bfbf1abba310", "name": "network-vif-deleted", "tag": "191cd60a-9fa7-4323-a105-c395e5b0bf4f"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:10.593531 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-07cd246d-0f02-4192-ad05-9e124cc269ec req-28e8032b-2c67-4001-840b-9fdf1066929e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:10.594016 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-07cd246d-0f02-4192-ad05-9e124cc269ec req-28e8032b-2c67-4001-840b-9fdf1066929e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:10.605604 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-07cd246d-0f02-4192-ad05-9e124cc269ec req-28e8032b-2c67-4001-840b-9fdf1066929e service nova] Creating event network-vif-deleted:191cd60a-9fa7-4323-a105-c395e5b0bf4f for instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 on hv-cinder-80295 Jul 12 22:17:10.610565 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-07cd246d-0f02-4192-ad05-9e124cc269ec req-28e8032b-2c67-4001-840b-9fdf1066929e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Jul 12 22:17:10.611160 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 493/995] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:17:10.833012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:10.833565 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:10.840254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:10.840733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:10.841518 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:10.841954 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:10.909848 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:10.918022 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7a7486b1-ee23-4f1a-885f-e63579d3bf36 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1392 microversion: 2.1 time: 0.089790 Jul 12 22:17:10.918475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 503/996] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:10 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1392 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:11.935853 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:11.936564 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:11.943947 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:11.944395 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:11.945200 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:11.945634 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:12.012095 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:12.020303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-dbb51d4a-486a-43af-9b96-a2fc11cacd26 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1225 microversion: 2.1 time: 0.089108 Jul 12 22:17:12.020885 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 494/997] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:11 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:13.037774 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:13.038388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:13.044915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:13.045371 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:13.046134 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:13.046576 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:13.108521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:13.116160 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-076c8219-6360-4a5d-b1a6-e079a2cf5d1d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 200 len: 1225 microversion: 2.1 time: 0.082855 Jul 12 22:17:13.116742 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 504/998] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:13 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:14.132609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:14.133195 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: fa130da8-ce09-4ff3-b08a-bfbf1abba310] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:14.139717 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:14.140162 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:14.140953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:14.141391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:14.155107 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] HTTP exception thrown: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Request method failure captured: Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 HTTP/1.1 Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfFYDP8FFPfo7G2eD9jBKzZSQ9E_Q5VbsglAszx-VgaFNIWOy6h7_YX6dqLSfrSqgvwHDte9KDHRxRWWbYpMomRkMAskhKdoqr1XB-pL2mcNyCCBCuECpUX8vWLpIFp54zbqqCFqG4gaxG8GxUZ4b7JrpMva71Vg_oElRlk_AKvOyJI Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:17:14.156882 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_80e867d86756459f9e4f53a4238d393d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 24a41c09f2e4487f9897c9888a0d752f Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. Jul 12 22:17:14.159131 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'fa130da8-ce09-4ff3-b08a-bfbf1abba310'} Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:17:14.160438 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. Jul 12 22:17:14.162053 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:14.163662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Returning 404 to user: Instance fa130da8-ce09-4ff3-b08a-bfbf1abba310 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:17:14.163662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ee9f2f1a-a8b1-4b38-86be-15354f4a025d tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310" status: 404 len: 111 microversion: 2.1 time: 0.029643 Jul 12 22:17:14.163662 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 495/999] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:14 2022] GET /compute/v2.1/servers/fa130da8-ce09-4ff3-b08a-bfbf1abba310 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:17:19.290267 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-cac4d142-5eec-464a-9c8e-1709cb1c91cd req-5701e7c1-fc55-4df9-abc3-dee5006825f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633c7eb7-6be2-4733-a41d-2a96653a5213", "tag": "ac8da1e2-11e6-4fdd-80f8-a62b641530e1"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:19.294133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:19.297670 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:19.308197 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:19.312487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-cac4d142-5eec-464a-9c8e-1709cb1c91cd req-5701e7c1-fc55-4df9-abc3-dee5006825f0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:19.313265 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:19.313940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-cac4d142-5eec-464a-9c8e-1709cb1c91cd req-5701e7c1-fc55-4df9-abc3-dee5006825f0 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:19.315191 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:19.318842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:19.336611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-cac4d142-5eec-464a-9c8e-1709cb1c91cd req-5701e7c1-fc55-4df9-abc3-dee5006825f0 service nova] Creating event network-changed:ac8da1e2-11e6-4fdd-80f8-a62b641530e1 for instance 633c7eb7-6be2-4733-a41d-2a96653a5213 on hv-cinder-80295 Jul 12 22:17:19.349549 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-cac4d142-5eec-464a-9c8e-1709cb1c91cd req-5701e7c1-fc55-4df9-abc3-dee5006825f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062892 Jul 12 22:17:19.354301 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 496/1000] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:17:19.362389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:17:19.466754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d4ad2fcd-7d90-47ba-92ac-1d376968997e tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "DELETE /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 204 len: 0 microversion: 2.1 time: 0.183210 Jul 12 22:17:19.468110 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 505/1001] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:17:19 2022] DELETE /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:17:19.478748 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:19.479624 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:19.488351 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:19.488832 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:19.489657 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:19.490096 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:19.631686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:19.640002 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-299cd90b-b6b4-4d8d-9b53-53cc69c952bb tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1578 microversion: 2.1 time: 0.167006 Jul 12 22:17:19.640583 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 497/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:19 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:20.659567 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:20.660248 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:20.666914 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:20.667366 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:20.668166 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:20.668605 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:20.811825 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:20.820236 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6ad75955-c157-4374-9cf7-97baf86827dd tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1578 microversion: 2.1 time: 0.165727 Jul 12 22:17:20.820810 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 506/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:20 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:21.837181 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:21.837795 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:21.844346 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:21.844962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:21.846383 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:21.846854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:21.988040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:21.996147 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-389a2add-b20f-4263-81db-ba1102500680 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1578 microversion: 2.1 time: 0.162804 Jul 12 22:17:21.996747 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 498/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:21 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:23.012844 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:23.013441 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:23.020546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:23.021021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:23.021828 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:23.022146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:23.343657 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a41c09f2e4487f9897c9888a0d752f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e867d86756459f9e4f53a4238d393d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:23.351798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-783939cd-4772-4af7-8fca-056c0332dc32 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 200 len: 1461 microversion: 2.1 time: 0.342891 Jul 12 22:17:23.352454 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 507/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:23 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 1461 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:23.525864 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-d8fb6d72-92e5-409e-b011-9062bd5d610a req-7c028ed4-a2f8-4dfe-a32b-278ee2ddf5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633c7eb7-6be2-4733-a41d-2a96653a5213", "name": "network-vif-deleted", "tag": "ac8da1e2-11e6-4fdd-80f8-a62b641530e1"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:23.536245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-d8fb6d72-92e5-409e-b011-9062bd5d610a req-7c028ed4-a2f8-4dfe-a32b-278ee2ddf5d5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:23.536693 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-d8fb6d72-92e5-409e-b011-9062bd5d610a req-7c028ed4-a2f8-4dfe-a32b-278ee2ddf5d5 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:23.554033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-d8fb6d72-92e5-409e-b011-9062bd5d610a req-7c028ed4-a2f8-4dfe-a32b-278ee2ddf5d5 service nova] Creating event network-vif-deleted:ac8da1e2-11e6-4fdd-80f8-a62b641530e1 for instance 633c7eb7-6be2-4733-a41d-2a96653a5213 on hv-cinder-80295 Jul 12 22:17:23.559327 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-d8fb6d72-92e5-409e-b011-9062bd5d610a req-7c028ed4-a2f8-4dfe-a32b-278ee2ddf5d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037352 Jul 12 22:17:23.560155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 499/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:17:24.368853 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:24.369402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: 633c7eb7-6be2-4733-a41d-2a96653a5213] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:24.375871 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.376381 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.377223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.377655 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.390763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] HTTP exception thrown: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Request method failure captured: Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 HTTP/1.1 Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfFYDP8FFPfo7G2eD9jBKzZSQ9E_Q5VbsglAszx-VgaFNIWOy6h7_YX6dqLSfrSqgvwHDte9KDHRxRWWbYpMomRkMAskhKdoqr1XB-pL2mcNyCCBCuECpUX8vWLpIFp54zbqqCFqG4gaxG8GxUZ4b7JrpMva71Vg_oElRlk_AKvOyJI Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:17:24.393365 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_80e867d86756459f9e4f53a4238d393d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 24a41c09f2e4487f9897c9888a0d752f Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. Jul 12 22:17:24.395217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': '633c7eb7-6be2-4733-a41d-2a96653a5213'} Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:17:24.396127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. Jul 12 22:17:24.397658 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.398959 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Returning 404 to user: Instance 633c7eb7-6be2-4733-a41d-2a96653a5213 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:17:24.398959 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-27f10520-71b4-4e1d-bb24-8e046f6285c5 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213" status: 404 len: 111 microversion: 2.1 time: 0.029861 Jul 12 22:17:24.398959 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 508/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:24 2022] GET /compute/v2.1/servers/633c7eb7-6be2-4733-a41d-2a96653a5213 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:17:24.844769 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:24.845391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:24.852291 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.852790 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.853555 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.853993 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.868216 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] HTTP exception thrown: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Request method failure captured: Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e HTTP/1.1 Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfFYDP8FFPfo7G2eD9jBKzZSQ9E_Q5VbsglAszx-VgaFNIWOy6h7_YX6dqLSfrSqgvwHDte9KDHRxRWWbYpMomRkMAskhKdoqr1XB-pL2mcNyCCBCuECpUX8vWLpIFp54zbqqCFqG4gaxG8GxUZ4b7JrpMva71Vg_oElRlk_AKvOyJI Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:17:24.869933 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_80e867d86756459f9e4f53a4238d393d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 24a41c09f2e4487f9897c9888a0d752f Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.871524 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'a3061dbc-2e72-428f-b5d7-12ec63ca924e'} Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:17:24.872355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.873670 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.875024 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Returning 404 to user: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:17:24.875024 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a87dcf58-8f4f-4991-9e7f-bc3223d8db53 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 404 len: 111 microversion: 2.1 time: 0.030828 Jul 12 22:17:24.875024 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 500/1008] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:17:24 2022] DELETE /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:17:24.881087 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:24.881710 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] [instance: a3061dbc-2e72-428f-b5d7-12ec63ca924e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:24.887739 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.888194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.889012 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:24.889455 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:24.903077 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] HTTP exception thrown: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Request method failure captured: Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e HTTP/1.1 Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Host: 10.222.0.44 Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizfFYDP8FFPfo7G2eD9jBKzZSQ9E_Q5VbsglAszx-VgaFNIWOy6h7_YX6dqLSfrSqgvwHDte9KDHRxRWWbYpMomRkMAskhKdoqr1XB-pL2mcNyCCBCuECpUX8vWLpIFp54zbqqCFqG4gaxG8GxUZ4b7JrpMva71Vg_oElRlk_AKvOyJI Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 22:17:24.904591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_80e867d86756459f9e4f53a4238d393d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/80e867d86756459f9e4f53a4238d393d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 80e867d86756459f9e4f53a4238d393d Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-678416096 Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Id: 24a41c09f2e4487f9897c9888a0d752f Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-678416096-project Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: method: > Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: exception: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.906210 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: action_args: {'id': 'a3061dbc-2e72-428f-b5d7-12ec63ca924e'} Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:17:24.907128 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. Jul 12 22:17:24.908835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 22:17:24.910157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Returning 404 to user: Instance a3061dbc-2e72-428f-b5d7-12ec63ca924e could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:17:24.910157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-35168bce-1c25-4c7a-adc6-dee5e771e984 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e" status: 404 len: 111 microversion: 2.1 time: 0.029440 Jul 12 22:17:24.910157 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 509/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:24 2022] GET /compute/v2.1/servers/a3061dbc-2e72-428f-b5d7-12ec63ca924e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:17:27.265250 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a48bb4a0-f692-4236-9255-e900f5e521b8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] Calling method '.version_select at 0x7f1b669cb040>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:27.288637 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a48bb4a0-f692-4236-9255-e900f5e521b8 tempest-TestVolumeBootPattern-678416096 tempest-TestVolumeBootPattern-678416096-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1581295142" status: 202 len: 0 microversion: 2.1 time: 0.027449 Jul 12 22:17:27.289289 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 501/1010] 10.222.0.44 () {58 vars in 1262 bytes} [Tue Jul 12 22:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1581295142 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:17:46.823399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:46.824035 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:46.829336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:46.830840 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:46.842835 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:46.849091 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-db35b3bb-fd1a-4013-9503-c057092ba69c req-7f5d0df4-325d-41d4-a408-3efc2537a3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:46.855146 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:46.856081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=42 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:46.857099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:46.857421 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:17:46.859406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:46.865030 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-db35b3bb-fd1a-4013-9503-c057092ba69c req-7f5d0df4-325d-41d4-a408-3efc2537a3d7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:46.865931 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-db35b3bb-fd1a-4013-9503-c057092ba69c req-7f5d0df4-325d-41d4-a408-3efc2537a3d7 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:46.879995 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-db35b3bb-fd1a-4013-9503-c057092ba69c req-7f5d0df4-325d-41d4-a408-3efc2537a3d7 service nova] Creating event network-changed:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:17:46.887255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-db35b3bb-fd1a-4013-9503-c057092ba69c req-7f5d0df4-325d-41d4-a408-3efc2537a3d7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042271 Jul 12 22:17:46.892573 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 502/1011] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:17:46.925941 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:17:47.083765 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8a0ea477-cad5-4ab9-835e-d77db5051231 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 204 len: 0 microversion: 2.1 time: 0.264044 Jul 12 22:17:47.085279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 510/1012] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:17:46 2022] DELETE /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:17:47.100910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:47.102681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:47.116940 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:47.118184 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:47.120127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:47.121599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:47.352431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:47.361206 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-499259ce-c7f5-4b19-94fa-018c76db49d7 tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.269380 Jul 12 22:17:47.362394 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 503/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:47 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:48.382521 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:48.383960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:48.390520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:48.392826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:48.393673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:48.394334 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:48.858228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:48.867808 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e6287c62-359d-4651-b60e-5c4db641929c tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1570 microversion: 2.1 time: 0.490502 Jul 12 22:17:48.868336 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 511/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:48 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1570 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:49.694238 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-715f962c-f881-4d5f-8158-64198ecdaa20 req-b821e239-fe3a-4aee-8ea5-f31384a145ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54bd1b3-a4f2-461f-a74c-340e7184c1f3", "name": "network-vif-deleted", "tag": "21146f66-ca95-4db3-8d91-cfeeee390a74"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:17:49.709348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-715f962c-f881-4d5f-8158-64198ecdaa20 req-b821e239-fe3a-4aee-8ea5-f31384a145ff service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:49.712992 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-715f962c-f881-4d5f-8158-64198ecdaa20 req-b821e239-fe3a-4aee-8ea5-f31384a145ff service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:49.729071 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-715f962c-f881-4d5f-8158-64198ecdaa20 req-b821e239-fe3a-4aee-8ea5-f31384a145ff service nova] Creating event network-vif-deleted:21146f66-ca95-4db3-8d91-cfeeee390a74 for instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 on hv-cinder-80295 Jul 12 22:17:49.734051 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-715f962c-f881-4d5f-8158-64198ecdaa20 req-b821e239-fe3a-4aee-8ea5-f31384a145ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044481 Jul 12 22:17:49.735199 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 504/1015] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:17:49.887121 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:49.887832 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:49.895635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:49.896331 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:49.897367 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:49.897811 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:49.968721 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624bdc53a8b34b46b5004532716b3985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46992df6b784a7abd397b8f3aeb827a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:17:49.979428 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-234ab565-71a2-41dc-9fe1-4efd7b0dd8ae tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 200 len: 1219 microversion: 2.1 time: 0.098458 Jul 12 22:17:49.980856 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 512/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:49 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:17:50.998735 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:50.999430 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] [instance: e54bd1b3-a4f2-461f-a74c-340e7184c1f3] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:17:51.007838 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:51.008592 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:51.009417 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:17:51.009871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:17:51.027585 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] HTTP exception thrown: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Request method failure captured: Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 HTTP/1.1 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfILdBnPMYeswl8belt7cb2fnpUeUgENTKdlxRMRdhko2NR9QJDZi46At6I1hJh8gGQ1XNk7wtNe_-cUhnsnQiqMxSgKACF8V9XARtufvCc-lwpNuE97WFFFmCKjzxIi6Oi2Wh-IrP_HVIjSA6Y4RiG5gbJmNY9-W78AiRUQgtrGZE4 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: b46992df6b784a7abd397b8f3aeb827a Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-TestShelveInstance-1429480404 Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:17:51.030029 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b46992df6b784a7abd397b8f3aeb827a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b46992df6b784a7abd397b8f3aeb827a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b46992df6b784a7abd397b8f3aeb827a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b46992df6b784a7abd397b8f3aeb827a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-TestShelveInstance-1429480404 Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: b46992df6b784a7abd397b8f3aeb827a Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-TestShelveInstance-1429480404 Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-TestShelveInstance-1429480404-project Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: 624bdc53a8b34b46b5004532716b3985 Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-TestShelveInstance-1429480404-project Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. Jul 12 22:17:51.031843 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': 'e54bd1b3-a4f2-461f-a74c-340e7184c1f3'} Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:17:51.032886 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. Jul 12 22:17:51.034428 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:17:51.038579 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Returning 404 to user: Instance e54bd1b3-a4f2-461f-a74c-340e7184c1f3 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:17:51.040588 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-1b0dac14-b450-4de4-a0f5-ea6285c4a8ff tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3" status: 404 len: 111 microversion: 2.1 time: 0.046564 Jul 12 22:17:51.041423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 505/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:17:50 2022] GET /compute/v2.1/servers/e54bd1b3-a4f2-461f-a74c-340e7184c1f3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:17:51.306883 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-22f2af63-6e47-429c-9efa-aee81abec82b tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] Calling method '.version_select at 0x7f1b6a9b8af0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:17:51.328547 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-22f2af63-6e47-429c-9efa-aee81abec82b tempest-TestShelveInstance-1429480404 tempest-TestShelveInstance-1429480404-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1291194408" status: 202 len: 0 microversion: 2.1 time: 0.025109 Jul 12 22:17:51.330074 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 513/1018] 10.222.0.44 () {58 vars in 1253 bytes} [Tue Jul 12 22:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1291194408 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:18:07.528225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4e80f0c8-8f98-4a4f-bfb1-2ee40427c716 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'create', calling method: .version_select at 0x7f1b668bf8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-42621237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXBv3Mbyq2fAmjOItdib44lf0WdoR+DxEQ1tGA3NaVnUDU+j4x+Xm9aDMR5RyANz/Q+5sGdCQAYAuESjTchLOcVQo5U+7seyBrtYZTH0zl17O4+tUvfSlTgh3IBD+V39A=="}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:07.532444 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=8 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:07.533261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=12 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:07.545076 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-4e80f0c8-8f98-4a4f-bfb1-2ee40427c716 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Getting quotas for project 43ac35d1693a46e49410be387243925e. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:18:07.548832 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.quota [None req-4e80f0c8-8f98-4a4f-bfb1-2ee40427c716 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Getting quotas for user fe3daae99f8143aca14bced56cb6c131 and project 43ac35d1693a46e49410be387243925e. Resources: {'key_pairs'} {{(pid=117937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:18:07.572069 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4e80f0c8-8f98-4a4f-bfb1-2ee40427c716 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.047873 Jul 12 22:18:07.572587 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 506/1019] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jul 12 22:18:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:07.667957 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:07.668731 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:07.673643 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-182726200", "imageRef": "dd7e9647-cdf0-43e2-ab63-2cba5aff90c3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-42621237", "networks": [{"uuid": "a6d083c2-af37-4101-9299-25ff41399c0f"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:07.727754 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] validate_networks() for [('a6d083c2-af37-4101-9299-25ff41399c0f', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 22:18:08.108959 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 22:18:08.109520 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 22:18:08.109926 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 22:18:08.110329 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 22:18:08.110742 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 22:18:08.120751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:08.121204 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:08.121993 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:08.122425 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:08.138589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Getting quotas for project 43ac35d1693a46e49410be387243925e. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 22:18:08.142523 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Getting quotas for user fe3daae99f8143aca14bced56cb6c131 and project 43ac35d1693a46e49410be387243925e. Resources: {'ram', 'instances', 'cores'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 22:18:08.153762 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 22:18:08.155938 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7e9647-cdf0-43e2-ab63-2cba5aff90c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 22:18:08.202483 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8cd789ae-45fe-42e0-87d3-b2328f21db36 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535821 Jul 12 22:18:08.203200 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 514/1020] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jul 12 22:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 22:18:08.213088 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9a295ad3-9400-4a57-9cb8-b6ac11e3f69c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:08.213706 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9a295ad3-9400-4a57-9cb8-b6ac11e3f69c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:08.270189 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9a295ad3-9400-4a57-9cb8-b6ac11e3f69c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:08.279367 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9a295ad3-9400-4a57-9cb8-b6ac11e3f69c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1256 microversion: 2.1 time: 0.070097 Jul 12 22:18:08.279948 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 507/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:08 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1256 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:09.297406 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:09.297999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:09.305403 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:09.305860 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:09.306638 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:09.307080 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:09.412284 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:09.420433 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b4fa30d4-c808-4d27-a68b-cdd6b4a1a5f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1314 microversion: 2.1 time: 0.127337 Jul 12 22:18:09.421034 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 515/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:09 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1314 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:10.438545 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:10.439255 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:10.447170 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:10.447674 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:10.448470 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:10.448973 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:10.598282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:10.606457 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-3a6cd50f-3d0a-4ab5-a8a3-54de4dad35f6 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.172009 Jul 12 22:18:10.607089 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 508/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:10 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:11.624114 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:11.624751 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:11.632195 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:11.632958 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:11.633944 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:11.634546 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:11.781228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:11.790363 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-42131ddd-25ac-4706-aa06-f45487b3aa40 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.170010 Jul 12 22:18:11.791549 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 516/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:11 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:12.808572 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:12.809196 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:12.816423 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:12.816897 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:12.818274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:12.818726 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:12.965440 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:12.974780 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d60f39ea-153c-4142-9689-21a67b1f4ec3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.170038 Jul 12 22:18:12.975609 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 509/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:12 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:13.992600 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:13.993979 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:14.000997 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:14.001680 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:14.002639 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:14.003259 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:14.149686 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:14.157298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6114f312-5632-4f37-b5a7-f0ac5e605b62 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.169288 Jul 12 22:18:14.157864 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 517/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:13 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:15.173967 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:15.174698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:15.181797 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:15.182248 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:15.183108 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:15.183454 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:15.320963 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:15.328666 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-43ddce13-b400-4cfd-bd29-21caf556ca5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.158722 Jul 12 22:18:15.329282 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 510/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:15 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:16.346388 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:16.348043 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:16.355124 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:16.355675 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:16.356533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:16.357302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:16.502978 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:16.511527 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fa3b0e7c-5f43-4929-9839-ffdf60aeb1f7 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.168963 Jul 12 22:18:16.512116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 518/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:16 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:17.530076 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:17.530702 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:17.551798 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:17.553261 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:17.554245 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:17.554834 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:17.735599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:17.744611 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5e145b65-4f2a-4d8a-aa6f-ccc8f6ffa08d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.218883 Jul 12 22:18:17.745042 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 511/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:17 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:17.811219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-0bf4dc5c-7c94-40a5-b633-8c5075687391 req-e7dd2c3c-6552-4f23-ac62-133c4d2e1648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:17.828996 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0bf4dc5c-7c94-40a5-b633-8c5075687391 req-e7dd2c3c-6552-4f23-ac62-133c4d2e1648 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:17.829439 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0bf4dc5c-7c94-40a5-b633-8c5075687391 req-e7dd2c3c-6552-4f23-ac62-133c4d2e1648 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:17.842125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-0bf4dc5c-7c94-40a5-b633-8c5075687391 req-e7dd2c3c-6552-4f23-ac62-133c4d2e1648 service nova] Creating event network-changed:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:18:17.847293 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-0bf4dc5c-7c94-40a5-b633-8c5075687391 req-e7dd2c3c-6552-4f23-ac62-133c4d2e1648 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040222 Jul 12 22:18:17.848220 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 519/1030] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:18.763132 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:18.763730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:18.765617 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=6 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:18.771652 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:18.772102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:18.772926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:18.773388 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:18.906758 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:18.914542 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-ee9478a1-835c-455a-9835-8bc8a3506517 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.155226 Jul 12 22:18:18.915120 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 512/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:18 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:19.935133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:19.935836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:19.938027 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:19.938915 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:19.947228 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:19.947606 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:19.948503 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:19.949085 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:20.144127 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:20.158295 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fb0599b5-bdb9-45f7-be6e-afd5dbea9baf tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.228974 Jul 12 22:18:20.158879 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 520/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:19 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:21.176558 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:21.177802 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:21.184493 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:21.184985 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:21.185752 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:21.186193 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:21.318467 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:21.325926 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-79a39401-cd9f-4cef-b2fc-bb7bb6dfcee9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.153292 Jul 12 22:18:21.326492 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 513/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:21 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:22.276394 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-0fb27776-30da-43d3-8644-895179e9371e req-c9ad3965-1bdf-4a7a-91eb-aaa7d4dc33f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "name": "network-vif-plugged", "status": "completed", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:22.284533 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0fb27776-30da-43d3-8644-895179e9371e req-c9ad3965-1bdf-4a7a-91eb-aaa7d4dc33f8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:22.284999 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-0fb27776-30da-43d3-8644-895179e9371e req-c9ad3965-1bdf-4a7a-91eb-aaa7d4dc33f8 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:22.296694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-0fb27776-30da-43d3-8644-895179e9371e req-c9ad3965-1bdf-4a7a-91eb-aaa7d4dc33f8 service nova] Creating event network-vif-plugged:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:18:22.302404 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-0fb27776-30da-43d3-8644-895179e9371e req-c9ad3965-1bdf-4a7a-91eb-aaa7d4dc33f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152348 Jul 12 22:18:22.302991 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 521/1034] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:22.342601 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:22.343355 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:22.350326 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:22.350784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:22.351561 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:22.351997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:22.498286 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:22.506871 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5afff818-4c50-40e3-831c-65b2753ca55e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.168112 Jul 12 22:18:22.507460 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 514/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:22 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:23.524964 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:23.525673 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:23.532450 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:23.532960 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:23.533733 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:23.534229 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:23.665604 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:23.672980 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-da2c17dd-04cd-4685-9981-c8e3a9ee0a70 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1356 microversion: 2.1 time: 0.152775 Jul 12 22:18:23.673542 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 522/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:23 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:24.690163 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:24.690761 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:24.698155 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:24.698599 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:24.699357 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:24.699791 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:24.826239 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:24.834726 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-c5f78f3b-ee69-402f-b7f3-d4507aefb79a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1547 microversion: 2.1 time: 0.148423 Jul 12 22:18:24.835303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 515/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:24 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:24.851171 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:24.851790 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:24.858467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:24.858918 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:24.859691 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:24.860129 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:24.991239 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:24.998743 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-07bdfebf-aab3-4665-9821-5e44845d4cba tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1547 microversion: 2.1 time: 0.151904 Jul 12 22:18:24.999303 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 523/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:24 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:25.014528 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:25.018061 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:25.018846 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Searching by: {'deleted': False, 'project_id': '43ac35d1693a46e49410be387243925e'} {{(pid=117937) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 22:18:25.025784 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:25.026172 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:25.026962 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:25.027398 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:25.118681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.multi_cell_list [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117937) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 22:18:25.215033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-736dbc49-9a83-4a71-8d63-907f57d9cf01 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204234 Jul 12 22:18:25.215608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 516/1039] 10.222.0.44 () {58 vars in 1124 bytes} [Tue Jul 12 22:18:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:25.226219 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:25.226837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:25.232939 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:25.233389 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:25.234154 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:25.234591 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:25.364992 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:25.372438 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f474295e-2f35-4514-a61e-9a2f3b584731 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1547 microversion: 2.1 time: 0.150582 Jul 12 22:18:25.373036 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 524/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:25 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:26.886742 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06df5ee7-da03-435e-a4fd-92173c7c49f9"}} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:26.887802 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:26.894319 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:26.894765 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:26.895684 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:26.896227 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:27.132829 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-a62b47c1-9263-49f8-bd0e-a58dbbc2f58c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249888 Jul 12 22:18:27.133605 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 517/1041] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jul 12 22:18:26 2022] POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:33.646014 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:33.646635 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:33.653668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:33.654122 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:33.654898 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:33.655342 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:33.783460 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:33.791475 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-24cb0bd6-555e-4269-8f36-6d734cbc1b3d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1593 microversion: 2.1 time: 0.149457 Jul 12 22:18:33.792037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 525/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:33 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:35.798607 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell0:SELECT=2 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:35.867530 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-2139d799-19c2-43b4-a396-5221fd54c198 req-3fe89268-c66c-4c01-bc40-25fb69dd77ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:35.877806 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2139d799-19c2-43b4-a396-5221fd54c198 req-3fe89268-c66c-4c01-bc40-25fb69dd77ae service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:35.877806 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-2139d799-19c2-43b4-a396-5221fd54c198 req-3fe89268-c66c-4c01-bc40-25fb69dd77ae service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:35.891012 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-2139d799-19c2-43b4-a396-5221fd54c198 req-3fe89268-c66c-4c01-bc40-25fb69dd77ae service nova] Creating event network-changed:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:18:35.897113 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-2139d799-19c2-43b4-a396-5221fd54c198 req-3fe89268-c66c-4c01-bc40-25fb69dd77ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099808 Jul 12 22:18:35.898178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 518/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:37.230044 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1698890257"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:37.230589 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:37.237384 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:37.237836 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:37.238599 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:37.239037 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:37.367466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.network.security_group_api [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Adding security group 51939fca-15c1-4638-b920-f1b7f9eb51a3 to port 4bd00f86-0c7d-457f-a353-2cca92605733 Jul 12 22:18:37.719335 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ca9ed13-e9da-49a6-946a-738125484f3f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action" status: 202 len: 0 microversion: 2.1 time: 0.493150 Jul 12 22:18:37.719946 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 526/1044] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:18:37 2022] POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:18:37.733223 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-b682e49b-71bc-4f52-9088-a8b28681fb8b req-73586938-3fe5-4826-82a8-37d267e92f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:37.736750 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:37.739603 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:37.741225 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:37.747054 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:37.757370 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:37.757890 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:37.763557 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b682e49b-71bc-4f52-9088-a8b28681fb8b req-73586938-3fe5-4826-82a8-37d267e92f2e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:37.764002 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-b682e49b-71bc-4f52-9088-a8b28681fb8b req-73586938-3fe5-4826-82a8-37d267e92f2e service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:37.767665 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:37.768116 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:37.774379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=65 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:37.785113 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:37.795234 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-b682e49b-71bc-4f52-9088-a8b28681fb8b req-73586938-3fe5-4826-82a8-37d267e92f2e service nova] Creating event network-changed:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:18:37.802151 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-b682e49b-71bc-4f52-9088-a8b28681fb8b req-73586938-3fe5-4826-82a8-37d267e92f2e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071391 Jul 12 22:18:37.807826 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 527/1045] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:18:37.988672 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:37.998961 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-4dbc8995-19a4-4914-89ea-9f2d7e01b844 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1758 microversion: 2.1 time: 0.273904 Jul 12 22:18:37.999546 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 519/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:37 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1758 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:54.982798 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:54.983596 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:54.988025 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:18:54.989709 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:54.996694 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:54.997163 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:54.997924 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:54.998369 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:55.071061 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6893fe0d-29c4-448a-87b1-0dd1eda8a5d3 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action" status: 202 len: 0 microversion: 2.1 time: 0.089681 Jul 12 22:18:55.071705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 528/1047] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:18:54 2022] POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:18:55.079898 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:55.080517 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:55.083202 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=1 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:55.083997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=5 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:18:55.090458 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:55.090910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:55.091685 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:55.092127 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:55.241488 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:55.249363 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-d4a6a1dd-f6c1-4c22-8177-6b59a45e6796 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1750 microversion: 2.1 time: 0.173450 Jul 12 22:18:55.249961 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 520/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:55 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:56.269148 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:56.270659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:56.277099 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:56.277545 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:56.278298 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:56.278724 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:56.424947 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:56.433491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c5e09c88-30c6-4028-9cad-5bda934e6eb5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.168981 Jul 12 22:18:56.434053 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 529/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:56 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:57.451178 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:57.451788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:57.458972 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:57.459414 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:57.460179 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:57.460608 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:57.602788 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:57.611033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-39ce3a06-f103-4d71-9749-e553e0524fdb tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.163645 Jul 12 22:18:57.611614 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 521/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:57 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:58.631066 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:58.631783 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:58.638837 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:58.639286 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:58.640212 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:58.640505 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:58.885399 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:18:58.893612 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-904afae6-75d7-4632-b03b-bfb1d17bc22f tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.268002 Jul 12 22:18:58.894186 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 530/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:58 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:18:59.912247 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:18:59.912842 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:18:59.919335 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:59.919782 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:18:59.920550 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:18:59.921033 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:00.064083 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:00.072475 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9feff75b-0827-4cf0-9e40-b0f49c880c66 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.164822 Jul 12 22:19:00.073074 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 522/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:18:59 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:01.090116 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:01.090663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:01.097346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:01.098285 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:01.099045 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:01.099480 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:01.239620 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:01.248017 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e9bd5e8c-438d-4c8f-848d-6e0827d6eb30 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.161688 Jul 12 22:19:01.248659 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 531/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:01 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:02.265600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:02.266228 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:02.273823 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:02.274280 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:02.275073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:02.275516 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:02.432181 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:02.443652 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-589b2914-7b0f-4c01-9349-7d9c4a882791 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.181693 Jul 12 22:19:02.444292 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 523/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:02 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:03.460842 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:03.461453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:03.467963 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:03.468408 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:03.469194 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:03.469633 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:03.622133 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:03.630158 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d7c157a0-9596-4620-b9c7-6b3b47561328 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.173263 Jul 12 22:19:03.630714 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 532/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:03 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:04.647487 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:04.648102 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:04.654348 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:04.654799 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:04.655586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:04.656027 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:04.802854 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:04.810941 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-6b845cea-5c9e-4eaf-99c8-3d66c0df3225 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.167572 Jul 12 22:19:04.811512 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 524/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:04 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:05.829161 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:05.829776 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:05.837456 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:05.837891 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:05.838653 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:05.839079 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:05.991217 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:05.999196 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0b4b22bd-3593-443d-b6e6-1d74178205d5 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1755 microversion: 2.1 time: 0.173901 Jul 12 22:19:05.999761 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 533/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:05 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:07.016812 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:07.017431 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:07.024372 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:07.024859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:07.025630 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:07.026072 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:07.167133 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:07.175268 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-66fa55fa-25a6-4236-be93-0e044d4b9680 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1758 microversion: 2.1 time: 0.162381 Jul 12 22:19:07.176730 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 525/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:07 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:39.559708 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1698890257"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:19:39.560364 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:39.562669 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=12 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:19:39.563491 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:19:39.569802 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:39.570246 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:39.571000 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:39.571436 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:39.705570 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.network.security_group_api [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Removing security group 51939fca-15c1-4638-b920-f1b7f9eb51a3 from port 4bd00f86-0c7d-457f-a353-2cca92605733 Jul 12 22:19:40.051773 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a868b7e8-a969-4be7-9452-e697f7f45440 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action" status: 202 len: 0 microversion: 2.1 time: 0.496032 Jul 12 22:19:40.056849 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 534/1059] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jul 12 22:19:39 2022] POST /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 22:19:40.063460 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-c66f07f1-5d8c-46fc-8a02-6a444d43cef0 req-1e6e7fa3-7fde-4d81-95e9-0cec81be45ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:19:40.074244 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_api:SELECT=12 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:19:40.074953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG dbcounter [-] [117937] Writing DB stats nova_cell1:SELECT=36 {{(pid=117937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 22:19:40.080299 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c66f07f1-5d8c-46fc-8a02-6a444d43cef0 req-1e6e7fa3-7fde-4d81-95e9-0cec81be45ae service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:40.080827 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-c66f07f1-5d8c-46fc-8a02-6a444d43cef0 req-1e6e7fa3-7fde-4d81-95e9-0cec81be45ae service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:40.107914 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-c66f07f1-5d8c-46fc-8a02-6a444d43cef0 req-1e6e7fa3-7fde-4d81-95e9-0cec81be45ae service nova] Creating event network-changed:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:19:40.127040 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-c66f07f1-5d8c-46fc-8a02-6a444d43cef0 req-1e6e7fa3-7fde-4d81-95e9-0cec81be45ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067927 Jul 12 22:19:40.127671 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 526/1060] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:19:41.143300 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:41.144397 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:41.145952 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-9b83f415-fecf-46c9-be68-f0407df85495 req-52c4bf69-34d8-4c6b-a941-073e612d29cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:19:41.151663 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:41.152341 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:41.153140 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:41.153575 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:41.156109 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9b83f415-fecf-46c9-be68-f0407df85495 req-52c4bf69-34d8-4c6b-a941-073e612d29cb service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:41.156630 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9b83f415-fecf-46c9-be68-f0407df85495 req-52c4bf69-34d8-4c6b-a941-073e612d29cb service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:41.170801 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-9b83f415-fecf-46c9-be68-f0407df85495 req-52c4bf69-34d8-4c6b-a941-073e612d29cb service nova] Creating event network-changed:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:19:41.175727 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-9b83f415-fecf-46c9-be68-f0407df85495 req-52c4bf69-34d8-4c6b-a941-073e612d29cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 Jul 12 22:19:41.177000 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 527/1061] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:19:41.243736 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lazy-loading 'services' on Instance uuid 48ee315e-2530-42e6-9a07-2362904bcb46 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:19:41.326863 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-62ffda9f-5f32-46e2-bb00-0d82c5a5e578 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments/06df5ee7-da03-435e-a4fd-92173c7c49f9" status: 202 len: 0 microversion: 2.1 time: 0.188217 Jul 12 22:19:41.332091 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 535/1062] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:19:41 2022] DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments/06df5ee7-da03-435e-a4fd-92173c7c49f9 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:19:41.337285 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:41.338659 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:41.345586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:41.346353 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:41.347318 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:41.347774 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:41.380073 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-7dacd46c-d9ad-45d2-a7a2-66645c532b5e tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047755 Jul 12 22:19:41.381055 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 528/1063] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:19:41 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 22:19:42.392725 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:42.393737 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:42.401177 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:42.401628 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:42.402427 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:42.402868 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:42.434055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8f06fbf2-7103-494e-b31f-82c9da4ea21d tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045685 Jul 12 22:19:42.434630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 536/1064] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jul 12 22:19:42 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 22:19:42.446013 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:42.446653 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:42.453122 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:42.453571 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:42.454347 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:42.454781 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:42.530281 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] HTTP exception thrown: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 is not attached to volume 06df5ee7-da03-435e-a4fd-92173c7c49f9 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Request method failure captured: Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments/06df5ee7-da03-435e-a4fd-92173c7c49f9 HTTP/1.1 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfMN4GgKnY0preqtn33zBUjpQGGbbcxabfXtJi3akyx9QL614u4il_6MfrGeD4aXNhQjd7A6JpsdvXYcsdpeEDraGkVAMSBpuaPfhCZZteepMndtb9V2U5fGJuzOJT3QquiMzMLmpqM6UPEOyPRiZygLdnPlU5x0EYCOH514-m5Sn3U Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 43ac35d1693a46e49410be387243925e Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:19:42.532600 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43ac35d1693a46e49410be387243925e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43ac35d1693a46e49410be387243925e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43ac35d1693a46e49410be387243925e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43ac35d1693a46e49410be387243925e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 43ac35d1693a46e49410be387243925e Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-TestMinimumBasicScenario-986451626-project Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: fe3daae99f8143aca14bced56cb6c131 Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-TestMinimumBasicScenario-986451626-project Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:19:42.534328 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 is not attached to volume 06df5ee7-da03-435e-a4fd-92173c7c49f9 Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'server_id': '48ee315e-2530-42e6-9a07-2362904bcb46', 'id': '06df5ee7-da03-435e-a4fd-92173c7c49f9'} Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 06df5ee7-da03-435e-a4fd-92173c7c49f9. Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:19:42.535274 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 is not attached to volume 06df5ee7-da03-435e-a4fd-92173c7c49f9 Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 is not attached to volume 06df5ee7-da03-435e-a4fd-92173c7c49f9 Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:42.536805 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Returning 404 to user: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 is not attached to volume 06df5ee7-da03-435e-a4fd-92173c7c49f9 {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:19:42.537997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-5b9048f2-3027-4018-b718-6dc08228e7dc tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments/06df5ee7-da03-435e-a4fd-92173c7c49f9" status: 404 len: 154 microversion: 2.1 time: 0.093127 Jul 12 22:19:42.537997 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 529/1065] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jul 12 22:19:42 2022] DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46/os-volume_attachments/06df5ee7-da03-435e-a4fd-92173c7c49f9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 22:19:43.672280 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:43.672856 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:43.680233 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:43.680453 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:43.681254 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:43.681763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:43.707379 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 22:19:43.785535 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eade9121-05dd-41d0-939e-cc1cd393e559 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 204 len: 0 microversion: 2.1 time: 0.116360 Jul 12 22:19:43.786346 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 537/1066] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jul 12 22:19:43 2022] DELETE /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 22:19:43.796211 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:43.796943 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:43.804034 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:43.805315 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:43.806101 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:43.806535 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:43.949154 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.policy [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117937) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:43.956686 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-024f4e15-8cd8-43aa-b284-c167df999cee tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1553 microversion: 2.1 time: 0.165130 Jul 12 22:19:43.958934 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 530/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:43 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 22:19:44.980318 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:44.981054 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:44.987677 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:44.988051 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:44.988889 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:44.989279 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:45.127021 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:45.135112 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bd7b685c-09a6-47b7-861c-aa8bfbc8bc3c tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1553 microversion: 2.1 time: 0.160033 Jul 12 22:19:45.135705 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 538/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:44 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:45.895649 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [req-9e84313a-096b-48bd-97b5-0da1ef0e8ac2 req-df278d7f-d608-44e6-bf6e-63194d310083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ee315e-2530-42e6-9a07-2362904bcb46", "name": "network-vif-deleted", "tag": "4bd00f86-0c7d-457f-a353-2cca92605733"}]} {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 22:19:45.904835 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9e84313a-096b-48bd-97b5-0da1ef0e8ac2 req-df278d7f-d608-44e6-bf6e-63194d310083 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:45.905281 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [req-9e84313a-096b-48bd-97b5-0da1ef0e8ac2 req-df278d7f-d608-44e6-bf6e-63194d310083 service nova] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:45.917152 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.compute.server_external_events [req-9e84313a-096b-48bd-97b5-0da1ef0e8ac2 req-df278d7f-d608-44e6-bf6e-63194d310083 service nova] Creating event network-vif-deleted:4bd00f86-0c7d-457f-a353-2cca92605733 for instance 48ee315e-2530-42e6-9a07-2362904bcb46 on hv-cinder-80295 Jul 12 22:19:45.921990 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [req-9e84313a-096b-48bd-97b5-0da1ef0e8ac2 req-df278d7f-d608-44e6-bf6e-63194d310083 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030261 Jul 12 22:19:45.922586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 531/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jul 12 22:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 22:19:46.151668 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:46.152218 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:46.160126 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:46.160630 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:46.161467 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:46.162466 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:46.199153 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:46.199603 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:46.200069 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lazy-loading 'fault' on Instance uuid 48ee315e-2530-42e6-9a07-2362904bcb46 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 22:19:46.246561 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3daae99f8143aca14bced56cb6c131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ac35d1693a46e49410be387243925e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 22:19:46.255292 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b8ee29b-ce8b-4801-a640-bd28ef8799c9 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 200 len: 1346 microversion: 2.1 time: 0.107554 Jul 12 22:19:46.256125 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 539/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:46 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 22:19:47.276868 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '>' {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:47.277705 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.compute.api [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] [instance: 48ee315e-2530-42e6-9a07-2362904bcb46] Fetching instance by UUID {{(pid=117937) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 22:19:47.283978 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:47.284523 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:47.285263 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 22:19:47.285698 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Lock "03585713-f424-48b7-abbc-188b30fcb0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 22:19:47.299910 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.wsgi [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] HTTP exception thrown: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Request method failure captured: Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: request: GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 HTTP/1.1 Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept: application/json Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Accept-Encoding: identity Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Connection: close Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Length: 0 Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Content-Type: application/json Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Host: 10.222.0.44 Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Openstack-System-Scope: None Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: User-Agent: python-urllib3/1.26.9 Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Auth-Token: gAAAAABizfMN4GgKnY0preqtn33zBUjpQGGbbcxabfXtJi3akyx9QL614u4il_6MfrGeD4aXNhQjd7A6JpsdvXYcsdpeEDraGkVAMSBpuaPfhCZZteepMndtb9V2U5fGJuzOJT3QquiMzMLmpqM6UPEOyPRiZygLdnPlU5x0EYCOH514-m5Sn3U Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Id: None Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Domain-Name: None Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Identity-Status: Confirmed Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Is-Admin-Project: True Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Id: default Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Domain-Name: Default Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Id: 43ac35d1693a46e49410be387243925e Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Project-Name: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Role: reader,member Jul 12 22:19:47.301586 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Roles: reader,member Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43ac35d1693a46e49410be387243925e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43ac35d1693a46e49410be387243925e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43ac35d1693a46e49410be387243925e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43ac35d1693a46e49410be387243925e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Id: 43ac35d1693a46e49410be387243925e Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-Tenant-Name: tempest-TestMinimumBasicScenario-986451626 Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User: tempest-TestMinimumBasicScenario-986451626-project Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Id: default Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Domain-Name: Default Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Id: fe3daae99f8143aca14bced56cb6c131 Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: X-User-Name: tempest-TestMinimumBasicScenario-986451626-project Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: method: > Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: exception: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. Jul 12 22:19:47.303229 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: action_args: {'id': '48ee315e-2530-42e6-9a07-2362904bcb46'} Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: {{(pid=117937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 22:19:47.304081 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. Jul 12 22:19:47.305859 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: ERROR nova.api.openstack.wsgi Jul 12 22:19:47.307086 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: DEBUG nova.api.openstack.wsgi [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Returning 404 to user: Instance 48ee315e-2530-42e6-9a07-2362904bcb46 could not be found. {{(pid=117937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 22:19:47.307086 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO nova.api.openstack.requestlog [None req-9cf4cb40-c14d-4b60-82b9-13ea4346809a tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46" status: 404 len: 111 microversion: 2.1 time: 0.032181 Jul 12 22:19:47.307086 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: [pid: 117937|app: 0|req: 532/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jul 12 22:19:47 2022] GET /compute/v2.1/servers/48ee315e-2530-42e6-9a07-2362904bcb46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 22:19:47.311905 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ac68fe5-f87d-4eec-bff2-26771c76fb38 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] Calling method '.version_select at 0x7f1b6a9a7550>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 22:19:47.330711 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ac68fe5-f87d-4eec-bff2-26771c76fb38 tempest-TestMinimumBasicScenario-986451626 tempest-TestMinimumBasicScenario-986451626-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-42621237" status: 202 len: 0 microversion: 2.1 time: 0.022669 Jul 12 22:19:47.331302 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 540/1072] 10.222.0.44 () {58 vars in 1265 bytes} [Tue Jul 12 22:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-42621237 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 22:20:57.156303 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:20:57.156960 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:21:03.291402 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:21:03.292023 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Tue Jul 12 22:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:21:04.487381 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:21:04.487970 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:22:35.604763 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:22:35.605410 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Tue Jul 12 22:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:22:56.330115 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:22:56.330834 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Tue Jul 12 22:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:22:57.549681 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:22:57.550284 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:24:17.165953 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:24:17.166694 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:24:23.301055 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:24:23.301634 dv-cinder-802955-7-iscsi devstack@n-api.service[117938]: Tue Jul 12 22:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 22:24:24.495737 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 22:24:24.496391 dv-cinder-802955-7-iscsi devstack@n-api.service[117937]: Tue Jul 12 22:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!